Oct 20 13:01:45 user nova-compute[74701]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74701) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 13:01:45 user nova-compute[74701]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74701) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 13:01:45 user nova-compute[74701]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74701) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 13:01:45 user nova-compute[74701]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 13:01:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:01:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:01:45 user nova-compute[74701]: INFO nova.virt.driver [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 13:01:46 user nova-compute[74701]: INFO nova.compute.provider_config [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Acquiring lock "singleton_lock" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Acquired lock "singleton_lock" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Releasing lock "singleton_lock" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Full set of CONF: {{(pid=74701) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ******************************************************************************** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Configuration options gathered from: {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ================================================================================ {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] allow_resize_to_same_host      = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] arq_binding_timeout            = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] backdoor_port                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] backdoor_socket                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] block_device_allocate_retries  = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] block_device_allocate_retries_interval = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cert                           = self.pem {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute_monitors               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] config_dir                     = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] config_drive_format            = iso9660 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] config_source                  = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] console_host                   = user {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] control_exchange               = nova {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cpu_allocation_ratio           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] daemon                         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] debug                          = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_access_ip_network_name = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_availability_zone      = nova {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_ephemeral_format       = ext4 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_green_pool_size        = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] default_schedule_zone          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] disk_allocation_ratio          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] enable_new_services            = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] enabled_ssl_apis               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] flat_injected                  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] force_config_drive             = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] force_raw_images               = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] graceful_shutdown_timeout      = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] heal_instance_info_cache_interval = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] host                           = user {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_build_timeout         = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_delete_interval       = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_name_template         = instance-%08x {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_usage_audit           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_usage_audit_period    = month {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] internal_service_availability_zone = internal {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] key                            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] live_migration_retry_count     = 30 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_config_append              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_dir                        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_file                       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_options                    = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_rotate_interval            = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_rotate_interval_type       = days {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] log_rotation_type              = none {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] long_rpc_timeout               = 1800 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_concurrent_builds          = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_concurrent_live_migrations = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_concurrent_snapshots       = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_local_block_devices        = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_logfile_count              = 30 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] max_logfile_size_mb            = 200 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] maximum_instance_delete_attempts = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metadata_listen                = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metadata_listen_port           = 8775 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metadata_workers               = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] migrate_max_retries            = -1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] mkisofs_cmd                    = genisoimage {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] my_ip                          = 10.0.0.210 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] network_allocate_retries       = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] osapi_compute_listen_port      = 8774 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] osapi_compute_unique_server_name_scope =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] osapi_compute_workers          = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] password_length                = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] periodic_enable                = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] periodic_fuzzy_delay           = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] pointer_model                  = ps2mouse {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] preallocate_images             = none {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] publish_errors                 = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] pybasedir                      = /opt/stack/nova {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ram_allocation_ratio           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rate_limit_burst               = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rate_limit_except_level        = CRITICAL {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rate_limit_interval            = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reboot_timeout                 = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reclaim_instance_interval      = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] record                         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reimage_timeout_per_gb         = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] report_interval                = 120 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rescue_timeout                 = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reserved_host_cpus             = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reserved_host_disk_mb          = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reserved_host_memory_mb        = 512 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] reserved_huge_pages            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] resize_confirm_window          = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] resize_fs_using_block_device   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] resume_guests_state_on_host_boot = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rpc_response_timeout           = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] run_external_periodic_tasks    = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] running_deleted_instance_action = reap {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] running_deleted_instance_timeout = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler_instance_sync_interval = 120 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_down_time              = 720 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] servicegroup_driver            = db {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] shelved_offload_time           = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] shelved_poll_interval          = 3600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] shutdown_timeout               = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] source_is_ipv6                 = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ssl_only                       = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] state_path                     = /opt/stack/data/nova {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] sync_power_state_interval      = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] sync_power_state_pool_size     = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] syslog_log_facility            = LOG_USER {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] tempdir                        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] timeout_nbd                    = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] transport_url                  = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] update_resources_interval      = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_cow_images                 = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_eventlog                   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_journal                    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_json                       = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_rootwrap_daemon            = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_stderr                     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] use_syslog                     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vcpu_pin_set                   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plugging_is_fatal          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plugging_timeout           = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] virt_mkfs                      = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] volume_usage_poll_interval     = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] watch_log_file                 = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] web                            = /usr/share/spice-html5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_concurrency.disable_process_locking = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.auth_strategy              = keystone {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.compute_link_prefix        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.dhcp_domain                = novalocal {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.enable_instance_password   = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.glance_link_prefix         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.instance_list_per_project_cells = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.list_records_by_skipping_down_cells = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.local_metadata_per_cell    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.max_limit                  = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.metadata_cache_expiration  = 15 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.neutron_default_tenant_id  = default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.use_forwarded_for          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.use_neutron_default_nets   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_dynamic_targets = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_jsonfile_path   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.backend_argument         = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.config_prefix            = cache.oslo {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.dead_timeout             = 60.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.debug_cache_backend      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.enable_retry_client      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.enable_socket_keepalive  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.enabled                  = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.expiration_time          = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.hashclient_retry_attempts = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_dead_retry      = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_password        =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_sasl_enabled    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.memcache_username        =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.proxies                  = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.retry_attempts           = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.retry_delay              = 0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.socket_keepalive_count   = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.socket_keepalive_idle    = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.socket_keepalive_interval = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.tls_allowed_ciphers      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.tls_cafile               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.tls_certfile             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.tls_enabled              = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cache.tls_keyfile              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.auth_section            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.auth_type               = password {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.cafile                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.certfile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.collect_timing          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.cross_az_attach         = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.debug                   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.endpoint_template       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.http_retries            = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.insecure                = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.keyfile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.os_region_name          = RegionOne {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.split_loggers           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cinder.timeout                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.cpu_dedicated_set      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.cpu_shared_set         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.image_type_exclude_list = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.resource_provider_association_refresh = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.shutdown_retry_interval = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] conductor.workers              = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] console.allowed_origins        = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] console.ssl_ciphers            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] console.ssl_minimum_version    = default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] consoleauth.token_ttl          = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.cafile                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.certfile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.collect_timing          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.connect_retries         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.connect_retry_delay     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.endpoint_override       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.insecure                = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.keyfile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.max_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.min_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.region_name             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.service_name            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.service_type            = accelerator {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.split_loggers           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.status_code_retries     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.timeout                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] cyborg.version                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.backend               = sqlalchemy {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.connection            = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.connection_debug      = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.connection_parameters =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.connection_recycle_time = 3600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.connection_trace      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.db_inc_retry_interval = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.db_max_retries        = 20 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.db_max_retry_interval = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.db_retry_interval     = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.max_overflow          = 50 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.max_pool_size         = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.max_retries           = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.mysql_wsrep_sync_wait = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.pool_timeout          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.retry_interval        = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.slave_connection      = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] database.sqlite_synchronous    = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.backend           = sqlalchemy {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.connection        = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.connection_debug  = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.connection_parameters =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.connection_recycle_time = 3600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.connection_trace  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.db_inc_retry_interval = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.db_max_retries    = 20 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.db_max_retry_interval = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.db_retry_interval = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.max_overflow      = 50 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.max_pool_size     = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.max_retries       = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.pool_timeout      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.retry_interval    = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.slave_connection  = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] api_database.sqlite_synchronous = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] devices.enabled_mdev_types     = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ephemeral_storage_encryption.enabled = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.api_servers             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.cafile                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.certfile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.collect_timing          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.connect_retries         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.connect_retry_delay     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.debug                   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.default_trusted_certificate_ids = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.enable_certificate_validation = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.enable_rbd_download     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.endpoint_override       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.insecure                = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.keyfile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.max_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.min_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.num_retries             = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.rbd_ceph_conf           =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.rbd_connect_timeout     = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.rbd_pool                =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.rbd_user                =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.region_name             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.service_name            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.service_type            = image {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.split_loggers           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.status_code_retries     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.timeout                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.verify_glance_signatures = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] glance.version                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] guestfs.debug                  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.config_drive_cdrom      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.config_drive_inject_password = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.enable_remotefx         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.instances_path_share    =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.limit_cpu_features      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.use_multipath_io        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.vswitch_name            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] mks.enabled                    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.manager_interval   = 2400 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.precache_concurrency = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.remove_unused_base_images = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] image_cache.subdirectory_name  = _base {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.api_max_retries         = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.api_retry_interval      = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.auth_section            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.auth_type               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.cafile                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.certfile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.collect_timing          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.conductor_group         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.connect_retries         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.connect_retry_delay     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.endpoint_override       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.insecure                = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.keyfile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.max_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.min_version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.peer_list               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.region_name             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.serial_console_state_timeout = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.service_name            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.service_type            = baremetal {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.split_loggers           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.status_code_retries     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.timeout                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ironic.version                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] key_manager.fixed_key          = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.barbican_api_version  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.barbican_endpoint     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.barbican_endpoint_type = public {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.barbican_region_name  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.cafile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.certfile              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.collect_timing        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.insecure              = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.keyfile               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.number_of_retries     = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.retry_delay           = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.send_service_user_token = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.split_loggers         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.timeout               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.verify_ssl            = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican.verify_ssl_path       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.auth_section = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.auth_type = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.cafile   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.certfile = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.collect_timing = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.insecure = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.keyfile  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.split_loggers = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] barbican_service_user.timeout  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.approle_role_id          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.approle_secret_id        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.cafile                   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.certfile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.collect_timing           = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.insecure                 = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.keyfile                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.kv_mountpoint            = secret {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.kv_path                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.kv_version               = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.namespace                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.root_token_id            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.split_loggers            = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.ssl_ca_crt_file          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.timeout                  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.use_ssl                  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.auth_section          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.auth_type             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.cafile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.certfile              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.collect_timing        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.connect_retries       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.connect_retry_delay   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.endpoint_override     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.insecure              = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.keyfile               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.max_version           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.min_version           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.region_name           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.service_name          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.service_type          = identity {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.split_loggers         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.status_code_retries   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.timeout               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] keystone.version               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.connection_uri         =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_mode               = custom {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: WARNING oslo_config.cfg [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_power_governor_high = performance {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_power_management   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.device_detach_attempts = 8 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.device_detach_timeout  = 20 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.disk_cachemodes        = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.disk_prefix            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.enabled_perf_events    = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.file_backed_memory     = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.gid_maps               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.hw_disk_discard        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.hw_machine_type        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_rbd_pool        = rbd {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_type            = default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.images_volume_group    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.inject_key             = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.inject_partition       = -2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.inject_password        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.iscsi_iface            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.iser_use_multipath     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_downtime = 500 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_inbound_addr = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_scheme  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_timeout_action = abort {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_tunnelled = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: WARNING oslo_config.cfg [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 13:01:46 user nova-compute[74701]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 13:01:46 user nova-compute[74701]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 13:01:46 user nova-compute[74701]: and ``live_migration_inbound_addr`` respectively.
Oct 20 13:01:46 user nova-compute[74701]: ).  Its value may be silently ignored in the future.
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.live_migration_with_native_tls = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.max_queues             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.nfs_mount_options      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_pcie_ports         = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.pmem_namespaces        = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.quobyte_client_cfg     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rbd_secret_uuid        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rbd_user               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rescue_image_id        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rescue_kernel_id       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.rx_queue_size          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.smbfs_mount_options    =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.snapshot_compression   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.snapshot_image_format  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.sparse_logical_volumes = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.swtpm_enabled          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.swtpm_group            = tss {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.swtpm_user             = tss {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.sysinfo_serial         = unique {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.tb_cache_size          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.tx_queue_size          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.uid_maps               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.use_virtio_for_bridges = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.virt_type              = kvm {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.volume_clear           = zero {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.volume_clear_size      = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.volume_use_multipath   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_cache_path   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.auth_section           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.auth_type              = password {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.cafile                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.certfile               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.collect_timing         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.connect_retries        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.connect_retry_delay    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.default_floating_pool  = public {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.endpoint_override      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.extension_sync_interval = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.http_retries           = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.insecure               = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.keyfile                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.max_version            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.min_version            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.ovs_bridge             = br-int {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.physnets               = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.region_name            = RegionOne {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.service_metadata_proxy = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.service_name           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.service_type           = network {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.split_loggers          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.status_code_retries    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.timeout                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] neutron.version                = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] notifications.bdms_in_notifications = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] notifications.default_level    = INFO {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] notifications.notification_format = unversioned {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] notifications.notify_on_state_change = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] pci.alias                      = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] pci.device_spec                = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] pci.report_in_placement        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.auth_section         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.auth_type            = password {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.cafile               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.certfile             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.collect_timing       = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.connect_retries      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.connect_retry_delay  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.default_domain_id    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.default_domain_name  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.domain_id            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.domain_name          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.endpoint_override    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.insecure             = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.keyfile              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.max_version          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.min_version          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.password             = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.project_domain_id    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.project_domain_name  = Default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.project_id           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.project_name         = service {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.region_name          = RegionOne {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.service_name         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.service_type         = placement {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.split_loggers        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.status_code_retries  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.system_scope         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.timeout              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.trust_id             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.user_domain_id       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.user_domain_name     = Default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.user_id              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.username             = placement {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] placement.version              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.cores                    = 20 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.count_usage_from_placement = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.injected_file_content_bytes = 10240 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.injected_file_path_length = 255 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.injected_files           = 5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.instances                = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.key_pairs                = 100 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.metadata_items           = 128 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.ram                      = 51200 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.recheck_quota            = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.server_group_members     = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] quota.server_groups            = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rdp.enabled                    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.image_metadata_prefilter = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.max_attempts         = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.max_placement_results = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] scheduler.workers              = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.host_subset_size = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.isolated_hosts = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.isolated_images = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.pci_in_placement = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.track_instance_changes = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metrics.required               = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metrics.weight_multiplier      = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] metrics.weight_setting         = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.enabled         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.port_range      = 10000:20000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] serial_console.serialproxy_port = 6083 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.auth_section      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.auth_type         = password {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.cafile            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.certfile          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.collect_timing    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.insecure          = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.keyfile           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.send_service_user_token = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.split_loggers     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] service_user.timeout           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.agent_enabled            = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.enabled                  = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.html5proxy_port          = 6082 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.image_compression        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.jpeg_compression         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.playback_compression     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.server_listen            = 127.0.0.1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.streaming_mode           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] spice.zlib_compression         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] upgrade_levels.baseapi         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] upgrade_levels.cert            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] upgrade_levels.compute         = auto {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] upgrade_levels.conductor       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] upgrade_levels.scheduler       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.cafile = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.certfile = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.insecure = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vendordata_dynamic_auth.timeout = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.api_retry_count         = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.ca_file                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.cache_prefix            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.cluster_name            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.connection_pool_size    = 10 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.console_delay_seconds   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.datastore_regex         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.host_ip                 = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.host_password           = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.host_port               = 443 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.host_username           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.insecure                = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.integration_bridge      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.maximum_objects         = 100 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.pbm_default_policy      = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.pbm_enabled             = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.pbm_wsdl_location       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.serial_port_proxy_uri   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.serial_port_service_uri = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.task_poll_interval      = 0.5 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.use_linked_clone        = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.vnc_keymap              = en-us {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.vnc_port                = 5900 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vmware.vnc_port_total          = 10000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.auth_schemes               = ['none'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.enabled                    = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.novncproxy_port            = 6080 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.vencrypt_ca_certs          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.vencrypt_client_cert       = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vnc.vencrypt_client_key        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.disable_rootwrap   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.enable_numa_live_migration = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.libvirt_disable_apic = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.client_socket_timeout     = 900 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.default_pool_size         = 1000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.keep_alive                = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.max_header_line           = 16384 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.ssl_ca_file               = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.ssl_cert_file             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.ssl_key_file              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.tcp_keepidle              = 600 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] zvm.ca_file                    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] zvm.cloud_connector_url        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] zvm.reachable_timeout          = 300 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.enforce_new_defaults = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.enforce_scope      = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.policy_default_rule = default {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.connection_string     = messaging:// {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.enabled               = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.es_doc_type           = notification {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.es_scroll_size        = 10000 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.es_scroll_time        = 2m {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.filter_error_trace    = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.hmac_keys             = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.sentinel_service_name = mymaster {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.socket_timeout        = 0.1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.trace_requests        = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler.trace_sqlalchemy      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler_jaeger.process_tags   = {} {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler_jaeger.service_name_prefix = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] profiler_otlp.service_name_prefix = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] remote_debug.host              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] remote_debug.port              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_notifications.retry = -1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.auth_section        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.auth_type           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.cafile              = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.certfile            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.collect_timing      = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.connect_retries     = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.connect_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.endpoint_id         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.endpoint_override   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.insecure            = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.keyfile             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.max_version         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.min_version         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.region_name         = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.service_name        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.service_type        = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.split_loggers       = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.status_code_retries = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.status_code_retry_delay = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.timeout             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.valid_interfaces    = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_limit.version             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_reports.file_event_handler = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] oslo_reports.log_dir           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.group  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] vif_plug_ovs_privileged.user   = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.isolate_vif         = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] os_brick.lock_path             = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.capabilities   = [21] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.group          = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.helper_command = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] privsep_osbrick.user           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.group           = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.helper_command  = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] nova_sys_admin.user            = None {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG oslo_service.service [None req-135fc99a-603d-4cf4-85d9-c4ddc7fde866 None None] ******************************************************************************** {{(pid=74701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 13:01:46 user nova-compute[74701]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Connecting to libvirt: qemu:///system {{(pid=74701) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f87013e62f0> {{(pid=74701) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 13:01:46 user nova-compute[74701]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 13:01:46 user nova-compute[74701]: WARNING nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f87013e62f0> {{(pid=74701) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Starting native event thread {{(pid=74701) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Starting green dispatch thread {{(pid=74701) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Starting connection event dispatch thread {{(pid=74701) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 13:01:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Connection event '1' reason 'None'
Oct 20 13:01:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 13:01:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.mount [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Initialising _HostMountState generation 0 {{(pid=74701) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 13:01:53 user nova-compute[74701]: INFO nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host capabilities <capabilities>
Oct 20 13:01:53 user nova-compute[74701]:   <host>
Oct 20 13:01:53 user nova-compute[74701]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 13:01:53 user nova-compute[74701]:     <cpu>
Oct 20 13:01:53 user nova-compute[74701]:       <arch>x86_64</arch>
Oct 20 13:01:53 user nova-compute[74701]:       <model>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:53 user nova-compute[74701]:       <microcode version='1070'/>
Oct 20 13:01:53 user nova-compute[74701]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 13:01:53 user nova-compute[74701]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='ss'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='vmx'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='pcid'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='osxsave'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='hypervisor'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='arat'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='tsc_adjust'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='md-clear'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='arch-capabilities'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='invtsc'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='rsba'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 13:01:53 user nova-compute[74701]:       <pages unit='KiB' size='4'/>
Oct 20 13:01:53 user nova-compute[74701]:       <pages unit='KiB' size='2048'/>
Oct 20 13:01:53 user nova-compute[74701]:     </cpu>
Oct 20 13:01:53 user nova-compute[74701]:     <power_management>
Oct 20 13:01:53 user nova-compute[74701]:       <suspend_mem/>
Oct 20 13:01:53 user nova-compute[74701]:       <suspend_disk/>
Oct 20 13:01:53 user nova-compute[74701]:       <suspend_hybrid/>
Oct 20 13:01:53 user nova-compute[74701]:     </power_management>
Oct 20 13:01:53 user nova-compute[74701]:     <iommu support='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     <migration_features>
Oct 20 13:01:53 user nova-compute[74701]:       <live/>
Oct 20 13:01:53 user nova-compute[74701]:       <uri_transports>
Oct 20 13:01:53 user nova-compute[74701]:         <uri_transport>tcp</uri_transport>
Oct 20 13:01:53 user nova-compute[74701]:         <uri_transport>rdma</uri_transport>
Oct 20 13:01:53 user nova-compute[74701]:       </uri_transports>
Oct 20 13:01:53 user nova-compute[74701]:     </migration_features>
Oct 20 13:01:53 user nova-compute[74701]:     <topology>
Oct 20 13:01:53 user nova-compute[74701]:       <cells num='2'>
Oct 20 13:01:53 user nova-compute[74701]:         <cell id='0'>
Oct 20 13:01:53 user nova-compute[74701]:           <memory unit='KiB'>8140616</memory>
Oct 20 13:01:53 user nova-compute[74701]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 20 13:01:53 user nova-compute[74701]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 13:01:53 user nova-compute[74701]:           <distances>
Oct 20 13:01:53 user nova-compute[74701]:             <sibling id='0' value='10'/>
Oct 20 13:01:53 user nova-compute[74701]:             <sibling id='1' value='20'/>
Oct 20 13:01:53 user nova-compute[74701]:           </distances>
Oct 20 13:01:53 user nova-compute[74701]:           <cpus num='6'>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 13:01:53 user nova-compute[74701]:           </cpus>
Oct 20 13:01:53 user nova-compute[74701]:         </cell>
Oct 20 13:01:53 user nova-compute[74701]:         <cell id='1'>
Oct 20 13:01:53 user nova-compute[74701]:           <memory unit='KiB'>8255100</memory>
Oct 20 13:01:53 user nova-compute[74701]:           <pages unit='KiB' size='4'>2063775</pages>
Oct 20 13:01:53 user nova-compute[74701]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 13:01:53 user nova-compute[74701]:           <distances>
Oct 20 13:01:53 user nova-compute[74701]:             <sibling id='0' value='20'/>
Oct 20 13:01:53 user nova-compute[74701]:             <sibling id='1' value='10'/>
Oct 20 13:01:53 user nova-compute[74701]:           </distances>
Oct 20 13:01:53 user nova-compute[74701]:           <cpus num='6'>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 13:01:53 user nova-compute[74701]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 13:01:53 user nova-compute[74701]:           </cpus>
Oct 20 13:01:53 user nova-compute[74701]:         </cell>
Oct 20 13:01:53 user nova-compute[74701]:       </cells>
Oct 20 13:01:53 user nova-compute[74701]:     </topology>
Oct 20 13:01:53 user nova-compute[74701]:     <cache>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 13:01:53 user nova-compute[74701]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 13:01:53 user nova-compute[74701]:     </cache>
Oct 20 13:01:53 user nova-compute[74701]:     <secmodel>
Oct 20 13:01:53 user nova-compute[74701]:       <model>apparmor</model>
Oct 20 13:01:53 user nova-compute[74701]:       <doi>0</doi>
Oct 20 13:01:53 user nova-compute[74701]:     </secmodel>
Oct 20 13:01:53 user nova-compute[74701]:     <secmodel>
Oct 20 13:01:53 user nova-compute[74701]:       <model>dac</model>
Oct 20 13:01:53 user nova-compute[74701]:       <doi>0</doi>
Oct 20 13:01:53 user nova-compute[74701]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 13:01:53 user nova-compute[74701]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 13:01:53 user nova-compute[74701]:     </secmodel>
Oct 20 13:01:53 user nova-compute[74701]:   </host>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='alpha'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>clipper</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='armv6l'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>spitz</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>nuri</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>kzm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>z2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>tosa</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n810</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>terrier</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>midway</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>microbit</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>verdex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>highbank</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>akita</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>connex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>collie</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='armv7l'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>spitz</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>nuri</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>kzm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>z2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>tosa</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n810</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>terrier</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>midway</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>microbit</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>verdex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>highbank</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>akita</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>connex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>collie</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='aarch64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>spitz</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>nuri</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>kzm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>z2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>tosa</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n810</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>n800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>terrier</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>midway</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>microbit</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>verdex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>highbank</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>akita</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>connex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>collie</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <acpi default='on' toggle='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='cris'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='i686'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>isapc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>microvm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='kvm'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <pae/>
Oct 20 13:01:53 user nova-compute[74701]:       <nonpae/>
Oct 20 13:01:53 user nova-compute[74701]:       <acpi default='on' toggle='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:       <apic default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='m68k'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>an5206</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>q800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='microblaze'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='microblazeel'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='mips'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>malta</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='mipsel'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>malta</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='mips64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>malta</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>pica61</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>magnum</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='mips64el'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>malta</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>pica61</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>magnum</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='16'>boston</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='ppc'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mac99</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>40p</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>taihu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='ppc64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>taihu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>40p</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mac99</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='ppc64le'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>taihu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>40p</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>mac99</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='riscv32'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='8'>spike</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='8'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='riscv64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='8'>spike</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='8'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='s390x'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='sh4'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>shix</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>r2d</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='sh4eb'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>shix</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>r2d</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='sparc'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>LX</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='sparc64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>niagara</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='x86_64'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>64</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='1'>isapc</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>microvm</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='kvm'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <acpi default='on' toggle='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:       <apic default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='xtensa'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>sim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>kc705</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ml605</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx200</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx60</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]:   <guest>
Oct 20 13:01:53 user nova-compute[74701]:     <os_type>hvm</os_type>
Oct 20 13:01:53 user nova-compute[74701]:     <arch name='xtensaeb'>
Oct 20 13:01:53 user nova-compute[74701]:       <wordsize>32</wordsize>
Oct 20 13:01:53 user nova-compute[74701]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='4'>sim</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>kc705</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ml605</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>virt</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx200</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>lx60</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 13:01:53 user nova-compute[74701]:       <domain type='qemu'/>
Oct 20 13:01:53 user nova-compute[74701]:     </arch>
Oct 20 13:01:53 user nova-compute[74701]:     <features>
Oct 20 13:01:53 user nova-compute[74701]:       <cpuselection/>
Oct 20 13:01:53 user nova-compute[74701]:       <deviceboot/>
Oct 20 13:01:53 user nova-compute[74701]:       <disksnapshot default='on' toggle='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     </features>
Oct 20 13:01:53 user nova-compute[74701]:   </guest>
Oct 20 13:01:53 user nova-compute[74701]: </capabilities>
Oct 20 13:01:53 user nova-compute[74701]: 
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 13:01:53 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 13:01:53 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:53 user nova-compute[74701]:   <machine>pc-i440fx-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:   <arch>i686</arch>
Oct 20 13:01:53 user nova-compute[74701]:   <vcpu max='255'/>
Oct 20 13:01:53 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='firmware'/>
Oct 20 13:01:53 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </loader>
Oct 20 13:01:53 user nova-compute[74701]:   </os>
Oct 20 13:01:53 user nova-compute[74701]:   <cpu>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='lm'/>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>kvm64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>core2duo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Penryn</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G1</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Conroe</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:   </cpu>
Oct 20 13:01:53 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:53 user nova-compute[74701]:     </enum>
Oct 20 13:01:53 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:53 user nova-compute[74701]:   <devices>
Oct 20 13:01:53 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>ide</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </disk>
Oct 20 13:01:53 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </graphics>
Oct 20 13:01:53 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </video>
Oct 20 13:01:53 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:53 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:53 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </rng>
Oct 20 13:01:53 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:53 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </tpm>
Oct 20 13:01:53 user nova-compute[74701]:   </devices>
Oct 20 13:01:53 user nova-compute[74701]:   <features>
Oct 20 13:01:53 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:   </features>
Oct 20 13:01:53 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 13:01:53 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 13:01:53 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:53 user nova-compute[74701]:   <machine>pc-q35-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:   <arch>i686</arch>
Oct 20 13:01:53 user nova-compute[74701]:   <vcpu max='288'/>
Oct 20 13:01:53 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='firmware'/>
Oct 20 13:01:53 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </loader>
Oct 20 13:01:53 user nova-compute[74701]:   </os>
Oct 20 13:01:53 user nova-compute[74701]:   <cpu>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='lm'/>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>kvm64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>core2duo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Penryn</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G1</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Conroe</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:   </cpu>
Oct 20 13:01:53 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:53 user nova-compute[74701]:     </enum>
Oct 20 13:01:53 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:53 user nova-compute[74701]:   <devices>
Oct 20 13:01:53 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </disk>
Oct 20 13:01:53 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </graphics>
Oct 20 13:01:53 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </video>
Oct 20 13:01:53 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:53 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:53 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </rng>
Oct 20 13:01:53 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:53 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </tpm>
Oct 20 13:01:53 user nova-compute[74701]:   </devices>
Oct 20 13:01:53 user nova-compute[74701]:   <features>
Oct 20 13:01:53 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:   </features>
Oct 20 13:01:53 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 13:01:53 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 13:01:53 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:53 user nova-compute[74701]:   <machine>pc-q35-6.2</machine>
Oct 20 13:01:53 user nova-compute[74701]:   <arch>i686</arch>
Oct 20 13:01:53 user nova-compute[74701]:   <vcpu max='288'/>
Oct 20 13:01:53 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='firmware'/>
Oct 20 13:01:53 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </loader>
Oct 20 13:01:53 user nova-compute[74701]:   </os>
Oct 20 13:01:53 user nova-compute[74701]:   <cpu>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:53 user nova-compute[74701]:       <feature policy='disable' name='lm'/>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>kvm64</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>core2duo</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Westmere</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Penryn</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Opteron_G1</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Nehalem</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Conroe</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:53 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:53 user nova-compute[74701]:     </mode>
Oct 20 13:01:53 user nova-compute[74701]:   </cpu>
Oct 20 13:01:53 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:53 user nova-compute[74701]:     </enum>
Oct 20 13:01:53 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:53 user nova-compute[74701]:   <devices>
Oct 20 13:01:53 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </disk>
Oct 20 13:01:53 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </graphics>
Oct 20 13:01:53 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </video>
Oct 20 13:01:53 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:53 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:53 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </rng>
Oct 20 13:01:53 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:53 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:53 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:53 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:53 user nova-compute[74701]:       </enum>
Oct 20 13:01:53 user nova-compute[74701]:     </tpm>
Oct 20 13:01:53 user nova-compute[74701]:   </devices>
Oct 20 13:01:53 user nova-compute[74701]:   <features>
Oct 20 13:01:53 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:53 user nova-compute[74701]:   </features>
Oct 20 13:01:53 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 13:01:53 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:53 user nova-compute[74701]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 13:01:53 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:53 user nova-compute[74701]:   <machine>pc-i440fx-jammy</machine>
Oct 20 13:01:53 user nova-compute[74701]:   <arch>i686</arch>
Oct 20 13:01:53 user nova-compute[74701]:   <vcpu max='255'/>
Oct 20 13:01:53 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:53 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:     <enum name='firmware'/>
Oct 20 13:01:53 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 13:01:53 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </loader>
Oct 20 13:01:54 user nova-compute[74701]:   </os>
Oct 20 13:01:54 user nova-compute[74701]:   <cpu>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='lm'/>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>kvm64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>core2duo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Westmere</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Penryn</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G1</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Conroe</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:   </cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:54 user nova-compute[74701]:   <devices>
Oct 20 13:01:54 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ide</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </disk>
Oct 20 13:01:54 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </graphics>
Oct 20 13:01:54 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </video>
Oct 20 13:01:54 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:54 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:54 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </rng>
Oct 20 13:01:54 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:54 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </tpm>
Oct 20 13:01:54 user nova-compute[74701]:   </devices>
Oct 20 13:01:54 user nova-compute[74701]:   <features>
Oct 20 13:01:54 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:   </features>
Oct 20 13:01:54 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 13:01:54 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 13:01:54 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:54 user nova-compute[74701]:   <machine>pc-i440fx-6.2</machine>
Oct 20 13:01:54 user nova-compute[74701]:   <arch>x86_64</arch>
Oct 20 13:01:54 user nova-compute[74701]:   <vcpu max='255'/>
Oct 20 13:01:54 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='firmware'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>efi</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </loader>
Oct 20 13:01:54 user nova-compute[74701]:   </os>
Oct 20 13:01:54 user nova-compute[74701]:   <cpu>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='invtsc'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='rsba'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>core2duo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Penryn</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Opteron_G1</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Conroe</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:   </cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:54 user nova-compute[74701]:   <devices>
Oct 20 13:01:54 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ide</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </disk>
Oct 20 13:01:54 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </graphics>
Oct 20 13:01:54 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </video>
Oct 20 13:01:54 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:54 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:54 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </rng>
Oct 20 13:01:54 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:54 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </tpm>
Oct 20 13:01:54 user nova-compute[74701]:   </devices>
Oct 20 13:01:54 user nova-compute[74701]:   <features>
Oct 20 13:01:54 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:   </features>
Oct 20 13:01:54 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 13:01:54 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 13:01:54 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:54 user nova-compute[74701]:   <machine>pc-q35-jammy</machine>
Oct 20 13:01:54 user nova-compute[74701]:   <arch>x86_64</arch>
Oct 20 13:01:54 user nova-compute[74701]:   <vcpu max='288'/>
Oct 20 13:01:54 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='firmware'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>efi</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </loader>
Oct 20 13:01:54 user nova-compute[74701]:   </os>
Oct 20 13:01:54 user nova-compute[74701]:   <cpu>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='invtsc'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='rsba'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>core2duo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Penryn</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Opteron_G1</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Conroe</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:   </cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:54 user nova-compute[74701]:   <devices>
Oct 20 13:01:54 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </disk>
Oct 20 13:01:54 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </graphics>
Oct 20 13:01:54 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </video>
Oct 20 13:01:54 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:54 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:54 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </rng>
Oct 20 13:01:54 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:54 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </tpm>
Oct 20 13:01:54 user nova-compute[74701]:   </devices>
Oct 20 13:01:54 user nova-compute[74701]:   <features>
Oct 20 13:01:54 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:   </features>
Oct 20 13:01:54 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 13:01:54 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 13:01:54 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:54 user nova-compute[74701]:   <machine>pc-q35-6.2</machine>
Oct 20 13:01:54 user nova-compute[74701]:   <arch>x86_64</arch>
Oct 20 13:01:54 user nova-compute[74701]:   <vcpu max='288'/>
Oct 20 13:01:54 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='firmware'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>efi</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </loader>
Oct 20 13:01:54 user nova-compute[74701]:   </os>
Oct 20 13:01:54 user nova-compute[74701]:   <cpu>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='invtsc'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='rsba'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>core2duo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Penryn</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Opteron_G1</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Conroe</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:   </cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:54 user nova-compute[74701]:   <devices>
Oct 20 13:01:54 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </disk>
Oct 20 13:01:54 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </graphics>
Oct 20 13:01:54 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </video>
Oct 20 13:01:54 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:54 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:54 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </rng>
Oct 20 13:01:54 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:54 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </tpm>
Oct 20 13:01:54 user nova-compute[74701]:   </devices>
Oct 20 13:01:54 user nova-compute[74701]:   <features>
Oct 20 13:01:54 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:   </features>
Oct 20 13:01:54 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 13:01:54 user nova-compute[74701]: <domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 13:01:54 user nova-compute[74701]:   <domain>kvm</domain>
Oct 20 13:01:54 user nova-compute[74701]:   <machine>pc-i440fx-jammy</machine>
Oct 20 13:01:54 user nova-compute[74701]:   <arch>x86_64</arch>
Oct 20 13:01:54 user nova-compute[74701]:   <vcpu max='255'/>
Oct 20 13:01:54 user nova-compute[74701]:   <iothreads supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:   <os supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='firmware'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>efi</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:     <loader supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>rom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pflash</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='readonly'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>yes</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='secure'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>no</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </loader>
Oct 20 13:01:54 user nova-compute[74701]:   </os>
Oct 20 13:01:54 user nova-compute[74701]:   <cpu>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-passthrough' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='hostPassthroughMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='maximum' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='maximumMigratable'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>on</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>off</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='host-model' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ss'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='vmx'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pcid'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='hypervisor'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arat'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='umip'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='md-clear'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='invtsc'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibpb'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='ibrs'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-stibp'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='rsba'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='erms'/>
Oct 20 13:01:54 user nova-compute[74701]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:     <mode name='custom' supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>qemu64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>qemu32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>phenom</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>pentium</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>n270</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm64</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>kvm32</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>coreduo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>core2duo</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>athlon</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Westmere</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Snowridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Skylake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>SandyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Penryn</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G5</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G4</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G3</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Opteron_G2</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Opteron_G1</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>IvyBridge</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Icelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Haswell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Rome</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-Milan</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>EPYC</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Dhyana</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cooperlake</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>Conroe</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='no'>Broadwell</model>
Oct 20 13:01:54 user nova-compute[74701]:       <model usable='yes'>486</model>
Oct 20 13:01:54 user nova-compute[74701]:     </mode>
Oct 20 13:01:54 user nova-compute[74701]:   </cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <memoryBacking supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:     <enum name='sourceType'>
Oct 20 13:01:54 user nova-compute[74701]:       <value>file</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>anonymous</value>
Oct 20 13:01:54 user nova-compute[74701]:       <value>memfd</value>
Oct 20 13:01:54 user nova-compute[74701]:     </enum>
Oct 20 13:01:54 user nova-compute[74701]:   </memoryBacking>
Oct 20 13:01:54 user nova-compute[74701]:   <devices>
Oct 20 13:01:54 user nova-compute[74701]:     <disk supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='diskDevice'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>disk</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cdrom</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>floppy</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>lun</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='bus'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ide</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>fdc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sata</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </disk>
Oct 20 13:01:54 user nova-compute[74701]:     <graphics supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='type'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>sdl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vnc</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>spice</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egl-headless</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </graphics>
Oct 20 13:01:54 user nova-compute[74701]:     <video supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='modelType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>cirrus</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>vmvga</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>qxl</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>none</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>bochs</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>ramfb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </video>
Oct 20 13:01:54 user nova-compute[74701]:     <hostdev supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='mode'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>subsystem</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='startupPolicy'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>default</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>mandatory</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>requisite</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>optional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='subsysType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>usb</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>pci</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>scsi</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='capsType'/>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='pciBackend'/>
Oct 20 13:01:54 user nova-compute[74701]:     </hostdev>
Oct 20 13:01:54 user nova-compute[74701]:     <rng supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtio-non-transitional</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>random</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>egd</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>builtin</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </rng>
Oct 20 13:01:54 user nova-compute[74701]:     <filesystem supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='driverType'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>path</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>handle</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>virtiofs</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </filesystem>
Oct 20 13:01:54 user nova-compute[74701]:     <tpm supported='yes'>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='model'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-tis</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>tpm-crb</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:       <enum name='backendModel'>
Oct 20 13:01:54 user nova-compute[74701]:         <value>passthrough</value>
Oct 20 13:01:54 user nova-compute[74701]:         <value>emulator</value>
Oct 20 13:01:54 user nova-compute[74701]:       </enum>
Oct 20 13:01:54 user nova-compute[74701]:     </tpm>
Oct 20 13:01:54 user nova-compute[74701]:   </devices>
Oct 20 13:01:54 user nova-compute[74701]:   <features>
Oct 20 13:01:54 user nova-compute[74701]:     <gic supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:     <vmcoreinfo supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <genid supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backingStoreInput supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <backup supported='yes'/>
Oct 20 13:01:54 user nova-compute[74701]:     <sev supported='no'/>
Oct 20 13:01:54 user nova-compute[74701]:   </features>
Oct 20 13:01:54 user nova-compute[74701]: </domainCapabilities>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74701) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74701) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Checking secure boot support for host arch (x86_64) {{(pid=74701) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Checking secure boot support for host arch (x86_64) {{(pid=74701) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Checking secure boot support for host arch (x86_64) {{(pid=74701) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Secure Boot support detected
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] cpu compare xml: <cpu match="exact">
Oct 20 13:01:54 user nova-compute[74701]:   <model>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]: </cpu>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.virt.node [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Generated node identity 40b83711-652c-474c-aa9f-09e010a7f984
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.virt.node [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Wrote node identity 40b83711-652c-474c-aa9f-09e010a7f984 to /opt/stack/data/nova/compute_id
Oct 20 13:01:54 user nova-compute[74701]: WARNING nova.compute.manager [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Compute nodes ['40b83711-652c-474c-aa9f-09e010a7f984'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.compute.manager [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 13:01:54 user nova-compute[74701]: WARNING nova.compute.manager [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 13:01:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:01:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:01:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Hypervisor/Node resource view: name=user free_ram=10998MB free_disk=26.034297943115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:01:54 user nova-compute[74701]: WARNING nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] No compute node record for user:40b83711-652c-474c-aa9f-09e010a7f984: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 40b83711-652c-474c-aa9f-09e010a7f984 could not be found.
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Compute node record created for user:user with uuid: 40b83711-652c-474c-aa9f-09e010a7f984
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] [req-a4ea8493-75de-4aa0-ad66-ef7d6c89c335] Created resource provider record via placement API for resource provider with UUID 40b83711-652c-474c-aa9f-09e010a7f984 and name user.
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74701) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 13:01:54 user nova-compute[74701]: INFO nova.virt.libvirt.host [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] kernel doesn't support AMD SEV
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Libvirt baseline CPU <cpu>
Oct 20 13:01:54 user nova-compute[74701]:   <arch>x86_64</arch>
Oct 20 13:01:54 user nova-compute[74701]:   <model>Nehalem</model>
Oct 20 13:01:54 user nova-compute[74701]:   <vendor>Intel</vendor>
Oct 20 13:01:54 user nova-compute[74701]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 13:01:54 user nova-compute[74701]: </cpu>
Oct 20 13:01:54 user nova-compute[74701]:  {{(pid=74701) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Updated inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Updating resource provider 40b83711-652c-474c-aa9f-09e010a7f984 generation from 0 to 1 during operation: update_inventory {{(pid=74701) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 13:01:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Updating resource provider 40b83711-652c-474c-aa9f-09e010a7f984 generation from 1 to 2 during operation: update_traits {{(pid=74701) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG nova.service [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Creating RPC server for service compute {{(pid=74701) start /opt/stack/nova/nova/service.py:182}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG nova.service [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] Join ServiceGroup membership for this service compute {{(pid=74701) start /opt/stack/nova/nova/service.py:199}}
Oct 20 13:01:55 user nova-compute[74701]: DEBUG nova.servicegroup.drivers.db [None req-1510da50-e6a9-450e-9a47-457c7d28adc2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74701) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 13:02:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:02:45 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:02:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:02:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=10432MB free_disk=25.937969207763672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:02:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:03:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:03:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:03:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=10371MB free_disk=26.00275421142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:03:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:03:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:03:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:03:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:04:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:04:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:04:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:04:45 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:04:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:04:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=10406MB free_disk=25.758079528808594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:04:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:04:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:04:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:05:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:05:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:05:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:05:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:05:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9636MB free_disk=25.776145935058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:05:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:05:51 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:05:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:05:59 user nova-compute[74701]: INFO nova.compute.claims [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Claim successful on node user
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Creating image(s)
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:00 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:00 user nova-compute[74701]: INFO nova.compute.claims [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Claim successful on node user
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.policy [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09e73f4fb1c410db0d365d04722a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea6d60f8e654cc2af2ec7085c001ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.virt.images [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] 5624a009-5482-4bf8-9162-de2cb54fd34f was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.part /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.944s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.part /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.converted" returned: 0 in 0.332s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.374s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:01 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc9zuk2_o/privsep.sock']
Oct 20 13:06:01 user sudo[83975]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc9zuk2_o/privsep.sock
Oct 20 13:06:01 user sudo[83975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.policy [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5a2fb1012774de08b84f6593eae8073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e48ad264d74341a6ee4c5d420385d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Creating image(s)
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:02 user nova-compute[74701]: INFO nova.compute.claims [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Claim successful on node user
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Creating image(s)
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG nova.policy [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5a2fb1012774de08b84f6593eae8073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e48ad264d74341a6ee4c5d420385d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:03 user sudo[83975]: pam_unix(sudo:session): session closed for user root
Oct 20 13:06:03 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Spawned new privsep daemon via rootwrap
Oct 20 13:06:03 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 13:06:03 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 13:06:03 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 13:06:03 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83987
Oct 20 13:06:03 user nova-compute[74701]: WARNING oslo_privsep.priv_context [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] privsep daemon already running
Oct 20 13:06:03 user nova-compute[74701]: WARNING oslo_privsep.priv_context [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] privsep daemon already running
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Successfully created port: 8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Successfully created port: 84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.245s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk 1073741824" returned: 0 in 0.049s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.245s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:04 user nova-compute[74701]: INFO nova.compute.claims [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Claim successful on node user
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.201s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk 1073741824" returned: 0 in 0.052s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.546s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Cannot resize image /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.267s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk 1073741824" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Cannot resize image /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Ensure instance console log exists: /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.831s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Cannot resize image /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Ensure instance console log exists: /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Creating image(s)
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "/opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "/opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG nova.policy [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49a7b9ce56444a689c334637d0a6ec37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6d495846294351927fa53aea7dd842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk 1073741824" returned: 0 in 0.045s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Cannot resize image /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Successfully created port: dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Successfully updated port: 8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquired lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Successfully updated port: 84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-changed-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Refreshing instance network info cache due to event network-changed-8a6e31c1-6831-440c-b25b-732eece5dfa5. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] Acquiring lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Successfully created port: b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating instance_info_cache with network_info: [{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Releasing lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Instance network_info: |[{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] Acquired lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Refreshing network info cache for port 8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Start _get_guest_xml network_info=[{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334892862',display_name='tempest-AttachVolumeNegativeTest-server-1334892862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334892862',id=1,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUxYE44T75VtBrflpaKhEMNEZhQDw64O2iNhYKC4+fp6W98u0YXiL6C7iZ4KmYwHqjT7S7ObHL53yKWA8P85VGwdchfxuzyZdil6Wh0jwqFComHEr7cB52mur6lownrPg==',key_name='tempest-keypair-224864113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-ka1dhi1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=d8e28db3-6b19-459f-b314-09ede99f9c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:08 user nova-compute[74701]:   <uuid>d8e28db3-6b19-459f-b314-09ede99f9c8d</uuid>
Oct 20 13:06:08 user nova-compute[74701]:   <name>instance-00000001</name>
Oct 20 13:06:08 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:08 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:08 user nova-compute[74701]:   <metadata>
Oct 20 13:06:08 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:08 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1334892862</nova:name>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:08</nova:creationTime>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:08 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:08 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:user uuid="a09e73f4fb1c410db0d365d04722a4fe">tempest-AttachVolumeNegativeTest-1431718944-project-member</nova:user>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:project uuid="3ea6d60f8e654cc2af2ec7085c001ea1">tempest-AttachVolumeNegativeTest-1431718944</nova:project>
Oct 20 13:06:08 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:08 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:08 user nova-compute[74701]:         <nova:port uuid="8a6e31c1-6831-440c-b25b-732eece5dfa5">
Oct 20 13:06:08 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:06:08 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:08 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:08 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:08 user nova-compute[74701]:   </metadata>
Oct 20 13:06:08 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:08 user nova-compute[74701]:     <system>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="serial">d8e28db3-6b19-459f-b314-09ede99f9c8d</entry>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="uuid">d8e28db3-6b19-459f-b314-09ede99f9c8d</entry>
Oct 20 13:06:08 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:08 user nova-compute[74701]:     </system>
Oct 20 13:06:08 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:08 user nova-compute[74701]:   <os>
Oct 20 13:06:08 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:08 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:08 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:08 user nova-compute[74701]:   </os>
Oct 20 13:06:08 user nova-compute[74701]:   <features>
Oct 20 13:06:08 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:08 user nova-compute[74701]:     <apic/>
Oct 20 13:06:08 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:08 user nova-compute[74701]:   </features>
Oct 20 13:06:08 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:08 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:08 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:08 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:08 user nova-compute[74701]:   </clock>
Oct 20 13:06:08 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:08 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:08 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:08 user nova-compute[74701]:   </cpu>
Oct 20 13:06:08 user nova-compute[74701]:   <devices>
Oct 20 13:06:08 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:08 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:08 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk"/>
Oct 20 13:06:08 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:08 user nova-compute[74701]:     </disk>
Oct 20 13:06:08 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:08 user nova-compute[74701]:       <mac address="fa:16:3e:4b:be:64"/>
Oct 20 13:06:08 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:08 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:08 user nova-compute[74701]:       <target dev="tap8a6e31c1-68"/>
Oct 20 13:06:08 user nova-compute[74701]:     </interface>
Oct 20 13:06:08 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:08 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/console.log" append="off"/>
Oct 20 13:06:08 user nova-compute[74701]:     </serial>
Oct 20 13:06:08 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:08 user nova-compute[74701]:     <video>
Oct 20 13:06:08 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:08 user nova-compute[74701]:     </video>
Oct 20 13:06:08 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:08 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:08 user nova-compute[74701]:     </rng>
Oct 20 13:06:08 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:08 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:08 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:08 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:08 user nova-compute[74701]:   </devices>
Oct 20 13:06:08 user nova-compute[74701]: </domain>
Oct 20 13:06:08 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334892862',display_name='tempest-AttachVolumeNegativeTest-server-1334892862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334892862',id=1,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUxYE44T75VtBrflpaKhEMNEZhQDw64O2iNhYKC4+fp6W98u0YXiL6C7iZ4KmYwHqjT7S7ObHL53yKWA8P85VGwdchfxuzyZdil6Wh0jwqFComHEr7cB52mur6lownrPg==',key_name='tempest-keypair-224864113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-ka1dhi1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=d8e28db3-6b19-459f-b314-09ede99f9c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG os_vif [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Created schema index Interface.name {{(pid=74701) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Created schema index Port.name {{(pid=74701) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Created schema index Bridge.name {{(pid=74701) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [POLLOUT] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance network_info: |[{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start _get_guest_xml network_info=[{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f00d1102-e2dd-59ec-8b00-d9769d1b6139', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:09 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd1u_32io/privsep.sock']
Oct 20 13:06:09 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:09 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:09 user sudo[84062]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd1u_32io/privsep.sock
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:09 user sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-27796603',display_name='tempest-ServerRescueNegativeTestJSON-server-27796603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-27796603',id=2,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-q76r6k3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:02Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Successfully updated port: dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:09 user nova-compute[74701]:   <uuid>d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</uuid>
Oct 20 13:06:09 user nova-compute[74701]:   <name>instance-00000002</name>
Oct 20 13:06:09 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:09 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:09 user nova-compute[74701]:   <metadata>
Oct 20 13:06:09 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:09 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-27796603</nova:name>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:09</nova:creationTime>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:09 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:09 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:06:09 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:09 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:09 user nova-compute[74701]:         <nova:port uuid="84ab858b-9317-44ab-bb71-12ee8268501b">
Oct 20 13:06:09 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 13:06:09 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:09 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:09 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:09 user nova-compute[74701]:   </metadata>
Oct 20 13:06:09 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:09 user nova-compute[74701]:     <system>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="serial">d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</entry>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="uuid">d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</entry>
Oct 20 13:06:09 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:09 user nova-compute[74701]:     </system>
Oct 20 13:06:09 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:09 user nova-compute[74701]:   <os>
Oct 20 13:06:09 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:09 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:09 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:09 user nova-compute[74701]:   </os>
Oct 20 13:06:09 user nova-compute[74701]:   <features>
Oct 20 13:06:09 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:09 user nova-compute[74701]:     <apic/>
Oct 20 13:06:09 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:09 user nova-compute[74701]:   </features>
Oct 20 13:06:09 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:09 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:09 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:09 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:09 user nova-compute[74701]:   </clock>
Oct 20 13:06:09 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:09 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:09 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:09 user nova-compute[74701]:   </cpu>
Oct 20 13:06:09 user nova-compute[74701]:   <devices>
Oct 20 13:06:09 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:09 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:09 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk"/>
Oct 20 13:06:09 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:09 user nova-compute[74701]:     </disk>
Oct 20 13:06:09 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:09 user nova-compute[74701]:       <mac address="fa:16:3e:12:41:2d"/>
Oct 20 13:06:09 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:09 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:09 user nova-compute[74701]:       <target dev="tap84ab858b-93"/>
Oct 20 13:06:09 user nova-compute[74701]:     </interface>
Oct 20 13:06:09 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:09 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/console.log" append="off"/>
Oct 20 13:06:09 user nova-compute[74701]:     </serial>
Oct 20 13:06:09 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:09 user nova-compute[74701]:     <video>
Oct 20 13:06:09 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:09 user nova-compute[74701]:     </video>
Oct 20 13:06:09 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:09 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:09 user nova-compute[74701]:     </rng>
Oct 20 13:06:09 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:09 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:09 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:09 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:09 user nova-compute[74701]:   </devices>
Oct 20 13:06:09 user nova-compute[74701]: </domain>
Oct 20 13:06:09 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-27796603',display_name='tempest-ServerRescueNegativeTestJSON-server-27796603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-27796603',id=2,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-q76r6k3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:02Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG os_vif [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9010c8f-8fa3-517a-9a06-24b27906f123', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Successfully updated port: b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquired lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-changed-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Refreshing instance network info cache due to event network-changed-dceb5cbd-d231-44b8-95fd-a2693ee7831a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-changed-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Refreshing instance network info cache due to event network-changed-84ab858b-9317-44ab-bb71-12ee8268501b. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Refreshing network info cache for port 84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-changed-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Refreshing instance network info cache due to event network-changed-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] Acquiring lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating instance_info_cache with network_info: [{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance network_info: |[{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Refreshing network info cache for port dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start _get_guest_xml network_info=[{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:10 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:10 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397688832',display_name='tempest-ServerRescueNegativeTestJSON-server-1397688832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397688832',id=3,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-vbunpiby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:03Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=0fd5f037-78df-4001-97b6-d4fec57b87d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Releasing lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Instance network_info: |[{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:10 user nova-compute[74701]:   <uuid>0fd5f037-78df-4001-97b6-d4fec57b87d5</uuid>
Oct 20 13:06:10 user nova-compute[74701]:   <name>instance-00000003</name>
Oct 20 13:06:10 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:10 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:10 user nova-compute[74701]:   <metadata>
Oct 20 13:06:10 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:10 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397688832</nova:name>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:10</nova:creationTime>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:10 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:port uuid="dceb5cbd-d231-44b8-95fd-a2693ee7831a">
Oct 20 13:06:10 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:06:10 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:10 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:10 user nova-compute[74701]:   </metadata>
Oct 20 13:06:10 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:10 user nova-compute[74701]:     <system>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="serial">0fd5f037-78df-4001-97b6-d4fec57b87d5</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="uuid">0fd5f037-78df-4001-97b6-d4fec57b87d5</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:10 user nova-compute[74701]:     </system>
Oct 20 13:06:10 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:10 user nova-compute[74701]:   <os>
Oct 20 13:06:10 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:10 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:10 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:10 user nova-compute[74701]:   </os>
Oct 20 13:06:10 user nova-compute[74701]:   <features>
Oct 20 13:06:10 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:10 user nova-compute[74701]:     <apic/>
Oct 20 13:06:10 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:10 user nova-compute[74701]:   </features>
Oct 20 13:06:10 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:10 user nova-compute[74701]:   </clock>
Oct 20 13:06:10 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:10 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:10 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:10 user nova-compute[74701]:   </cpu>
Oct 20 13:06:10 user nova-compute[74701]:   <devices>
Oct 20 13:06:10 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:10 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:10 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk"/>
Oct 20 13:06:10 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:     </disk>
Oct 20 13:06:10 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:10 user nova-compute[74701]:       <mac address="fa:16:3e:f0:91:6b"/>
Oct 20 13:06:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:10 user nova-compute[74701]:       <target dev="tapdceb5cbd-d2"/>
Oct 20 13:06:10 user nova-compute[74701]:     </interface>
Oct 20 13:06:10 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:10 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/console.log" append="off"/>
Oct 20 13:06:10 user nova-compute[74701]:     </serial>
Oct 20 13:06:10 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:10 user nova-compute[74701]:     <video>
Oct 20 13:06:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:     </video>
Oct 20 13:06:10 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:10 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:10 user nova-compute[74701]:     </rng>
Oct 20 13:06:10 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:10 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:10 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:10 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:10 user nova-compute[74701]:   </devices>
Oct 20 13:06:10 user nova-compute[74701]: </domain>
Oct 20 13:06:10 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397688832',display_name='tempest-ServerRescueNegativeTestJSON-server-1397688832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397688832',id=3,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-vbunpiby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:03Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=0fd5f037-78df-4001-97b6-d4fec57b87d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG os_vif [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] Acquired lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Refreshing network info cache for port b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Start _get_guest_xml network_info=[{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8da2f13-6bdb-52d7-b079-a504a7369f86', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:10 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:10 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17466101',display_name='tempest-ServerStableDeviceRescueTest-server-17466101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17466101',id=4,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiYtoKkFTmshdDUNXqr+S1h49XYGSKmEtp28zlHIlpcmLfdgYaXu0MKiXcXtGFaFkrgozFStitE5dNkOXy5nD0JXiQ7epwGTBR652B6ofG61gfnhspKVCSklByJrdPEEQ==',key_name='tempest-keypair-864934035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6d495846294351927fa53aea7dd842',ramdisk_id='',reservation_id='r-0kfsar65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1514521890',owner_user_name='tempest-ServerStableDeviceRescueTest-1514521890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a7b9ce56444a689c334637d0a6ec37',uuid=4f50c459-c21a-4050-9d1c-730a224c8cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converting VIF {"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f50c459-c21a-4050-9d1c-730a224c8cf9 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:10 user nova-compute[74701]:   <uuid>4f50c459-c21a-4050-9d1c-730a224c8cf9</uuid>
Oct 20 13:06:10 user nova-compute[74701]:   <name>instance-00000004</name>
Oct 20 13:06:10 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:10 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:10 user nova-compute[74701]:   <metadata>
Oct 20 13:06:10 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:10 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-17466101</nova:name>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:10</nova:creationTime>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:10 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:user uuid="49a7b9ce56444a689c334637d0a6ec37">tempest-ServerStableDeviceRescueTest-1514521890-project-member</nova:user>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:project uuid="0f6d495846294351927fa53aea7dd842">tempest-ServerStableDeviceRescueTest-1514521890</nova:project>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:10 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:10 user nova-compute[74701]:         <nova:port uuid="b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0">
Oct 20 13:06:10 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 13:06:10 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:10 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:10 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:10 user nova-compute[74701]:   </metadata>
Oct 20 13:06:10 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:10 user nova-compute[74701]:     <system>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="serial">4f50c459-c21a-4050-9d1c-730a224c8cf9</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="uuid">4f50c459-c21a-4050-9d1c-730a224c8cf9</entry>
Oct 20 13:06:10 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:10 user nova-compute[74701]:     </system>
Oct 20 13:06:10 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:10 user nova-compute[74701]:   <os>
Oct 20 13:06:10 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:10 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:10 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:10 user nova-compute[74701]:   </os>
Oct 20 13:06:10 user nova-compute[74701]:   <features>
Oct 20 13:06:10 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:10 user nova-compute[74701]:     <apic/>
Oct 20 13:06:10 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:10 user nova-compute[74701]:   </features>
Oct 20 13:06:10 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:10 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:10 user nova-compute[74701]:   </clock>
Oct 20 13:06:10 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:10 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:10 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:10 user nova-compute[74701]:   </cpu>
Oct 20 13:06:10 user nova-compute[74701]:   <devices>
Oct 20 13:06:10 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:10 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:10 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk"/>
Oct 20 13:06:10 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:     </disk>
Oct 20 13:06:10 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:10 user nova-compute[74701]:       <mac address="fa:16:3e:b7:33:20"/>
Oct 20 13:06:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:10 user nova-compute[74701]:       <target dev="tapb89b2ae8-cb"/>
Oct 20 13:06:10 user nova-compute[74701]:     </interface>
Oct 20 13:06:10 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:10 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/console.log" append="off"/>
Oct 20 13:06:10 user nova-compute[74701]:     </serial>
Oct 20 13:06:10 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:10 user nova-compute[74701]:     <video>
Oct 20 13:06:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:10 user nova-compute[74701]:     </video>
Oct 20 13:06:10 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:10 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:10 user nova-compute[74701]:     </rng>
Oct 20 13:06:10 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:10 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:10 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:10 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:10 user nova-compute[74701]:   </devices>
Oct 20 13:06:10 user nova-compute[74701]: </domain>
Oct 20 13:06:10 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17466101',display_name='tempest-ServerStableDeviceRescueTest-server-17466101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17466101',id=4,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiYtoKkFTmshdDUNXqr+S1h49XYGSKmEtp28zlHIlpcmLfdgYaXu0MKiXcXtGFaFkrgozFStitE5dNkOXy5nD0JXiQ7epwGTBR652B6ofG61gfnhspKVCSklByJrdPEEQ==',key_name='tempest-keypair-864934035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6d495846294351927fa53aea7dd842',ramdisk_id='',reservation_id='r-0kfsar65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1514521890',owner_user_name='tempest-ServerStableDeviceRescueTest-1514521890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a7b9ce56444a689c334637d0a6ec37',uuid=4f50c459-c21a-4050-9d1c-730a224c8cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converting VIF {"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG os_vif [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9fd872c-c097-5140-9114-585fb9f57b37', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:10 user sudo[84062]: pam_unix(sudo:session): session closed for user root
Oct 20 13:06:10 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Spawned new privsep daemon via rootwrap
Oct 20 13:06:10 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 13:06:10 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 13:06:10 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 13:06:10 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84075
Oct 20 13:06:10 user nova-compute[74701]: WARNING oslo_privsep.priv_context [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] privsep daemon already running
Oct 20 13:06:10 user nova-compute[74701]: WARNING oslo_privsep.priv_context [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] privsep daemon already running
Oct 20 13:06:10 user nova-compute[74701]: WARNING oslo_privsep.priv_context [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] privsep daemon already running
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updated VIF entry in instance network info cache for port 8a6e31c1-6831-440c-b25b-732eece5dfa5. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating instance_info_cache with network_info: [{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ff52f0-b1e0-4b73-aa6d-7b022826d6bc req-18a952e6-3e47-4a95-b66a-cfdf94b05b57 service nova] Releasing lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a6e31c1-68, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a6e31c1-68, col_values=(('qos', UUID('9c0aaaa5-7b28-4551-a5b3-2c6e49201567')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a6e31c1-68, col_values=(('external_ids', {'iface-id': '8a6e31c1-6831-440c-b25b-732eece5dfa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:be:64', 'vm-uuid': 'd8e28db3-6b19-459f-b314-09ede99f9c8d'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: INFO os_vif [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68')
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updated VIF entry in instance network info cache for port dceb5cbd-d231-44b8-95fd-a2693ee7831a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84ab858b-93, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84ab858b-93, col_values=(('qos', UUID('6d7e214a-cda9-49ea-b66b-583de83e3f6e')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84ab858b-93, col_values=(('external_ids', {'iface-id': '84ab858b-9317-44ab-bb71-12ee8268501b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:41:2d', 'vm-uuid': 'd6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb352e79-fa86-4b9c-8271-21d4a9d60bfd req-d6d75778-596c-4626-b9fe-1b46b5f5e21b service nova] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: INFO os_vif [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93')
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb89b2ae8-cb, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb89b2ae8-cb, col_values=(('qos', UUID('24fbe8c7-76fc-493f-94ee-261292eacc0f')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb89b2ae8-cb, col_values=(('external_ids', {'iface-id': 'b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:33:20', 'vm-uuid': '4f50c459-c21a-4050-9d1c-730a224c8cf9'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: INFO os_vif [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb')
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdceb5cbd-d2, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdceb5cbd-d2, col_values=(('qos', UUID('bbe99fb1-7a6a-4a6a-a3a0-736d037a3f40')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdceb5cbd-d2, col_values=(('external_ids', {'iface-id': 'dceb5cbd-d231-44b8-95fd-a2693ee7831a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:91:6b', 'vm-uuid': '0fd5f037-78df-4001-97b6-d4fec57b87d5'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:4b:be:64, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updated VIF entry in instance network info cache for port 84ab858b-9317-44ab-bb71-12ee8268501b. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:11 user nova-compute[74701]: INFO os_vif [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2')
Oct 20 13:06:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-38e0d494-1850-41a1-a0d5-a83ea6b59abc req-d9cc4d4a-4e39-4761-ae36-f4618bc1def1 service nova] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:12:41:2d, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] No VIF found with MAC fa:16:3e:b7:33:20, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:f0:91:6b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updated VIF entry in instance network info cache for port b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating instance_info_cache with network_info: [{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-640622b0-2800-4c5d-9141-f849a843e73c req-1b6ec4ac-aca6-4638-aa85-cfc0d3deb0f4 service nova] Releasing lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:18 user nova-compute[74701]: INFO nova.compute.claims [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Claim successful on node user
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] No waiting events found dispatching network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:18 user nova-compute[74701]: WARNING nova.compute.manager [req-e5935c56-2aff-4ea1-b1de-03cdd842bb3c req-37374c00-70bf-45e2-8106-0db1d5c2d7ee service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received unexpected event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 for instance with vm_state building and task_state spawning.
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:18 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.policy [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e643924dcc704c3bacad93ee0dd803dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d3196b12fd43c183b0b9e8324efa5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance spawned successfully.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance spawned successfully.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Creating image(s)
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "/opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "/opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Instance spawned successfully.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Instance spawned successfully.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Took 16.46 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Took 17.46 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.229s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Took 19.42 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:19 user nova-compute[74701]: INFO nova.compute.manager [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Took 17.42 seconds to build instance.
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.261s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7523edd6-50ed-43b3-a63e-dee3e21ec514 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.664s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk 1073741824" returned: 0 in 0.149s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.417s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:20 user nova-compute[74701]: INFO nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Took 14.59 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:20 user nova-compute[74701]: INFO nova.compute.manager [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Took 19.72 seconds to build instance.
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5c301d45-1886-48f2-a802-96b2e45ba9d4 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.852s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:20 user nova-compute[74701]: INFO nova.compute.manager [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Took 20.68 seconds to build instance.
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f7659f1-dfd0-4741-8051-d7e0b6b6d336 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.862s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:20 user nova-compute[74701]: INFO nova.compute.manager [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Took 16.07 seconds to build instance.
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.351s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f6ebde0a-8ccc-4ecd-a600-9fba03448851 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.307s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.374s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Cannot resize image /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Ensure instance console log exists: /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] No waiting events found dispatching network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:21 user nova-compute[74701]: WARNING nova.compute.manager [req-eecd1f12-0bd3-43ec-b849-0835e0dd52bd req-da1f46f7-4f93-4c3a-8c21-380b643ac38f service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received unexpected event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 for instance with vm_state active and task_state None.
Oct 20 13:06:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:21 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Successfully created port: 038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Successfully updated port: 038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquired lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:22 user nova-compute[74701]: INFO nova.compute.claims [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Claim successful on node user
Oct 20 13:06:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-changed-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Refreshing instance network info cache due to event network-changed-038c3665-0c3f-4ebb-b170-e3764a313137. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] Acquiring lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Releasing lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Instance network_info: |[{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] Acquired lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.neutron [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Refreshing network info cache for port 038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Start _get_guest_xml network_info=[{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2012380686',display_name='tempest-VolumesAdminNegativeTest-server-2012380686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2012380686',id=5,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkedxgu7emfvAUh9ykf7WbEvPJOZUyY4Ar3wOh23+vTSLe1FpvWzpwYm3YBeLokxaR8+ISzaBI86o5sAZri9riM8aS653N20S4Npyh2gutObOUuLhK5WFMDUIlvwY28cA==',key_name='tempest-keypair-1775119559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-w5ltex07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=b8dbbea7-4330-4bdd-adea-7b28bfca9726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'pci_devices' on Instance uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:23 user nova-compute[74701]:   <uuid>b8dbbea7-4330-4bdd-adea-7b28bfca9726</uuid>
Oct 20 13:06:23 user nova-compute[74701]:   <name>instance-00000005</name>
Oct 20 13:06:23 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:23 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:23 user nova-compute[74701]:   <metadata>
Oct 20 13:06:23 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:23 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2012380686</nova:name>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:23</nova:creationTime>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:23 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:23 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:user uuid="e643924dcc704c3bacad93ee0dd803dc">tempest-VolumesAdminNegativeTest-245051053-project-member</nova:user>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:project uuid="04d3196b12fd43c183b0b9e8324efa5c">tempest-VolumesAdminNegativeTest-245051053</nova:project>
Oct 20 13:06:23 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:23 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:23 user nova-compute[74701]:         <nova:port uuid="038c3665-0c3f-4ebb-b170-e3764a313137">
Oct 20 13:06:23 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 13:06:23 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:23 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:23 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:23 user nova-compute[74701]:   </metadata>
Oct 20 13:06:23 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:23 user nova-compute[74701]:     <system>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="serial">b8dbbea7-4330-4bdd-adea-7b28bfca9726</entry>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="uuid">b8dbbea7-4330-4bdd-adea-7b28bfca9726</entry>
Oct 20 13:06:23 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:23 user nova-compute[74701]:     </system>
Oct 20 13:06:23 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:23 user nova-compute[74701]:   <os>
Oct 20 13:06:23 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:23 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:23 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:23 user nova-compute[74701]:   </os>
Oct 20 13:06:23 user nova-compute[74701]:   <features>
Oct 20 13:06:23 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:23 user nova-compute[74701]:     <apic/>
Oct 20 13:06:23 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:23 user nova-compute[74701]:   </features>
Oct 20 13:06:23 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:23 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:23 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:23 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:23 user nova-compute[74701]:   </clock>
Oct 20 13:06:23 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:23 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:23 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:23 user nova-compute[74701]:   </cpu>
Oct 20 13:06:23 user nova-compute[74701]:   <devices>
Oct 20 13:06:23 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:23 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:23 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk"/>
Oct 20 13:06:23 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:23 user nova-compute[74701]:     </disk>
Oct 20 13:06:23 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:23 user nova-compute[74701]:       <mac address="fa:16:3e:2c:53:84"/>
Oct 20 13:06:23 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:23 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:23 user nova-compute[74701]:       <target dev="tap038c3665-0c"/>
Oct 20 13:06:23 user nova-compute[74701]:     </interface>
Oct 20 13:06:23 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:23 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/console.log" append="off"/>
Oct 20 13:06:23 user nova-compute[74701]:     </serial>
Oct 20 13:06:23 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:23 user nova-compute[74701]:     <video>
Oct 20 13:06:23 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:23 user nova-compute[74701]:     </video>
Oct 20 13:06:23 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:23 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:23 user nova-compute[74701]:     </rng>
Oct 20 13:06:23 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:23 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:23 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:23 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:23 user nova-compute[74701]:   </devices>
Oct 20 13:06:23 user nova-compute[74701]: </domain>
Oct 20 13:06:23 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2012380686',display_name='tempest-VolumesAdminNegativeTest-server-2012380686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2012380686',id=5,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkedxgu7emfvAUh9ykf7WbEvPJOZUyY4Ar3wOh23+vTSLe1FpvWzpwYm3YBeLokxaR8+ISzaBI86o5sAZri9riM8aS653N20S4Npyh2gutObOUuLhK5WFMDUIlvwY28cA==',key_name='tempest-keypair-1775119559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-w5ltex07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=b8dbbea7-4330-4bdd-adea-7b28bfca9726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG os_vif [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c48ab0da-e78f-56ea-9be0-63cf5b6cd485', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038c3665-0c, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap038c3665-0c, col_values=(('qos', UUID('56203af5-788e-429c-a842-2d1cade84209')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap038c3665-0c, col_values=(('external_ids', {'iface-id': '038c3665-0c3f-4ebb-b170-e3764a313137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:53:84', 'vm-uuid': 'b8dbbea7-4330-4bdd-adea-7b28bfca9726'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:23 user nova-compute[74701]: INFO os_vif [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c')
Oct 20 13:06:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.172s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No VIF found with MAC fa:16:3e:2c:53:84, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:24 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.policy [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dba610d54304e97a821cfbc8a9afdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f488ba901ff54233ad1c76fe275e686b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updated VIF entry in instance network info cache for port 038c3665-0c3f-4ebb-b170-e3764a313137. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58b31832-1e00-4fbc-b696-2b77775de7d9 req-18d277aa-da8e-4ce5-86a9-bafc08523e8f service nova] Releasing lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:24 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Creating image(s)
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.part --force-share --output=json" returned: 0 in 0.344s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG nova.virt.images [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] ed53af54-0448-4bd6-9049-b4817673931b was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.part /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.part /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.converted" returned: 0 in 0.305s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82.converted --force-share --output=json" returned: 0 in 0.298s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.810s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json" returned: 0 in 0.230s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82,backing_fmt=raw /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82,backing_fmt=raw /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk 1073741824" returned: 0 in 0.119s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82 --force-share --output=json" returned: 0 in 0.336s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Successfully created port: f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Cannot resize image /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Ensure instance console log exists: /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Successfully updated port: f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquired lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-changed-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Refreshing instance network info cache due to event network-changed-f3292852-36fd-437d-bd66-28f5403e3cf4. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] Acquiring lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updating instance_info_cache with network_info: [{"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Instance spawned successfully.
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Releasing lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Instance network_info: |[{"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] Acquired lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Refreshing network info cache for port f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Start _get_guest_xml network_info=[{"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:06:14Z,direct_url=<?>,disk_format='qcow2',id=ed53af54-0448-4bd6-9049-b4817673931b,min_disk=0,min_ram=0,name='',owner='c4df9f88a525404f9410c07fae510a8d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'image_id': 'ed53af54-0448-4bd6-9049-b4817673931b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:06:14Z,direct_url=<?>,disk_format='qcow2',id=ed53af54-0448-4bd6-9049-b4817673931b,min_disk=0,min_ram=0,name='',owner='c4df9f88a525404f9410c07fae510a8d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1663521948',display_name='tempest-AttachSCSIVolumeTestJSON-server-1663521948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1663521948',id=6,image_ref='ed53af54-0448-4bd6-9049-b4817673931b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV4WLEjAlSXE8zApAjP/0xkeFaVbm9lsfiU4dSJwma0upjIQHrBQQSlV9GzqVHSND6vjJ1dHw9LV/ue7PIOPhEOkCI0/hFDLj31JRKTHo2CIXvFfjBD3fR8/j058w0yjA==',key_name='tempest-keypair-641217935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f488ba901ff54233ad1c76fe275e686b',ramdisk_id='',reservation_id='r-b0e2sqbd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed53af54-0448-4bd6-9049-b4817673931b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1878732776',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1878732776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dba610d54304e97a821cfbc8a9afdf7',uuid=d5453469-c50d-41c0-a39b-a0d4d3add762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converting VIF {"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lazy-loading 'pci_devices' on Instance uuid d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:29 user nova-compute[74701]:   <uuid>d5453469-c50d-41c0-a39b-a0d4d3add762</uuid>
Oct 20 13:06:29 user nova-compute[74701]:   <name>instance-00000006</name>
Oct 20 13:06:29 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:29 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:29 user nova-compute[74701]:   <metadata>
Oct 20 13:06:29 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:29 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1663521948</nova:name>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:29</nova:creationTime>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:29 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:29 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:user uuid="2dba610d54304e97a821cfbc8a9afdf7">tempest-AttachSCSIVolumeTestJSON-1878732776-project-member</nova:user>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:project uuid="f488ba901ff54233ad1c76fe275e686b">tempest-AttachSCSIVolumeTestJSON-1878732776</nova:project>
Oct 20 13:06:29 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:root type="image" uuid="ed53af54-0448-4bd6-9049-b4817673931b"/>
Oct 20 13:06:29 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:29 user nova-compute[74701]:         <nova:port uuid="f3292852-36fd-437d-bd66-28f5403e3cf4">
Oct 20 13:06:29 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:06:29 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:29 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:29 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:29 user nova-compute[74701]:   </metadata>
Oct 20 13:06:29 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:29 user nova-compute[74701]:     <system>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="serial">d5453469-c50d-41c0-a39b-a0d4d3add762</entry>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="uuid">d5453469-c50d-41c0-a39b-a0d4d3add762</entry>
Oct 20 13:06:29 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:29 user nova-compute[74701]:     </system>
Oct 20 13:06:29 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:29 user nova-compute[74701]:   <os>
Oct 20 13:06:29 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:29 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:29 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:29 user nova-compute[74701]:   </os>
Oct 20 13:06:29 user nova-compute[74701]:   <features>
Oct 20 13:06:29 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:29 user nova-compute[74701]:     <apic/>
Oct 20 13:06:29 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:29 user nova-compute[74701]:   </features>
Oct 20 13:06:29 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:29 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:29 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:29 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:29 user nova-compute[74701]:   </clock>
Oct 20 13:06:29 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:29 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:29 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:29 user nova-compute[74701]:   </cpu>
Oct 20 13:06:29 user nova-compute[74701]:   <devices>
Oct 20 13:06:29 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:29 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:29 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk"/>
Oct 20 13:06:29 user nova-compute[74701]:       <target dev="sda" bus="scsi"/>
Oct 20 13:06:29 user nova-compute[74701]:       <address type="drive" controller="0" unit="0"/>
Oct 20 13:06:29 user nova-compute[74701]:     </disk>
Oct 20 13:06:29 user nova-compute[74701]:     <disk type="file" device="cdrom">
Oct 20 13:06:29 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 13:06:29 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.config"/>
Oct 20 13:06:29 user nova-compute[74701]:       <target dev="sdb" bus="scsi"/>
Oct 20 13:06:29 user nova-compute[74701]:       <address type="drive" controller="0" unit="1"/>
Oct 20 13:06:29 user nova-compute[74701]:     </disk>
Oct 20 13:06:29 user nova-compute[74701]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 13:06:29 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:29 user nova-compute[74701]:       <mac address="fa:16:3e:91:57:3e"/>
Oct 20 13:06:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:29 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:29 user nova-compute[74701]:       <target dev="tapf3292852-36"/>
Oct 20 13:06:29 user nova-compute[74701]:     </interface>
Oct 20 13:06:29 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:29 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/console.log" append="off"/>
Oct 20 13:06:29 user nova-compute[74701]:     </serial>
Oct 20 13:06:29 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:29 user nova-compute[74701]:     <video>
Oct 20 13:06:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:29 user nova-compute[74701]:     </video>
Oct 20 13:06:29 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:29 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:29 user nova-compute[74701]:     </rng>
Oct 20 13:06:29 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:29 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:29 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:29 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:29 user nova-compute[74701]:   </devices>
Oct 20 13:06:29 user nova-compute[74701]: </domain>
Oct 20 13:06:29 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1663521948',display_name='tempest-AttachSCSIVolumeTestJSON-server-1663521948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1663521948',id=6,image_ref='ed53af54-0448-4bd6-9049-b4817673931b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV4WLEjAlSXE8zApAjP/0xkeFaVbm9lsfiU4dSJwma0upjIQHrBQQSlV9GzqVHSND6vjJ1dHw9LV/ue7PIOPhEOkCI0/hFDLj31JRKTHo2CIXvFfjBD3fR8/j058w0yjA==',key_name='tempest-keypair-641217935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f488ba901ff54233ad1c76fe275e686b',ramdisk_id='',reservation_id='r-b0e2sqbd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed53af54-0448-4bd6-9049-b4817673931b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1878732776',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1878732776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dba610d54304e97a821cfbc8a9afdf7',uuid=d5453469-c50d-41c0-a39b-a0d4d3add762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converting VIF {"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG os_vif [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2c1138a-e9de-5d35-aa51-51ef60bbc025', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3292852-36, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3292852-36, col_values=(('qos', UUID('e88d3f94-f990-43be-9945-d6da48fba97d')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3292852-36, col_values=(('external_ids', {'iface-id': 'f3292852-36fd-437d-bd66-28f5403e3cf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:57:3e', 'vm-uuid': 'd5453469-c50d-41c0-a39b-a0d4d3add762'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:29 user nova-compute[74701]: INFO os_vif [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36')
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:29 user nova-compute[74701]: INFO nova.compute.claims [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Claim successful on node user
Oct 20 13:06:29 user nova-compute[74701]: INFO nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Took 10.11 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No BDM found with device name sda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No VIF found with MAC fa:16:3e:91:57:3e, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Using config drive
Oct 20 13:06:29 user nova-compute[74701]: INFO nova.compute.manager [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Took 11.33 seconds to build instance.
Oct 20 13:06:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9948c42-f878-44a5-be1a-a689664b10bf tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.533s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updated VIF entry in instance network info cache for port f3292852-36fd-437d-bd66-28f5403e3cf4. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updating instance_info_cache with network_info: [{"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-efc929bf-e1fa-4b05-8fb1-b788a10a9b0b req-7b9fdc5b-6aaa-410a-a903-e13b33cd6d3a service nova] Releasing lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Creating config drive at /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.config
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe_op_xjk {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe_op_xjk" returned: 0 in 0.080s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.policy [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3350fab957a47ea9f835198cbd20119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7907705534cadabf146dd7de662d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Creating image(s)
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.232s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk 1073741824" returned: 0 in 0.060s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Successfully created port: 5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.283s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Cannot resize image /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Ensure instance console log exists: /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] No waiting events found dispatching network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:32 user nova-compute[74701]: WARNING nova.compute.manager [req-26ac68df-3f1f-4f21-8fac-dfe822b4423d req-86e6ae9f-4353-4aec-9a0e-8ba5598c437c service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received unexpected event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 for instance with vm_state building and task_state spawning.
Oct 20 13:06:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Successfully updated port: 5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Instance network_info: |[{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Start _get_guest_xml network_info=[{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:34 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:34 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'pci_devices' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:34 user nova-compute[74701]:   <uuid>bdb0629d-0150-445c-b842-52a1c0ebbd41</uuid>
Oct 20 13:06:34 user nova-compute[74701]:   <name>instance-00000007</name>
Oct 20 13:06:34 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:34 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:34 user nova-compute[74701]:   <metadata>
Oct 20 13:06:34 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:34 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:34</nova:creationTime>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:34 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:34 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:06:34 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:34 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:34 user nova-compute[74701]:         <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:06:34 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:06:34 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:34 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:34 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:34 user nova-compute[74701]:   </metadata>
Oct 20 13:06:34 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:34 user nova-compute[74701]:     <system>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="serial">bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="uuid">bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:06:34 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:34 user nova-compute[74701]:     </system>
Oct 20 13:06:34 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:34 user nova-compute[74701]:   <os>
Oct 20 13:06:34 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:34 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:34 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:34 user nova-compute[74701]:   </os>
Oct 20 13:06:34 user nova-compute[74701]:   <features>
Oct 20 13:06:34 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:34 user nova-compute[74701]:     <apic/>
Oct 20 13:06:34 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:34 user nova-compute[74701]:   </features>
Oct 20 13:06:34 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:34 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:34 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:34 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:34 user nova-compute[74701]:   </clock>
Oct 20 13:06:34 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:34 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:34 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:34 user nova-compute[74701]:   </cpu>
Oct 20 13:06:34 user nova-compute[74701]:   <devices>
Oct 20 13:06:34 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:34 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:34 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk"/>
Oct 20 13:06:34 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:34 user nova-compute[74701]:     </disk>
Oct 20 13:06:34 user nova-compute[74701]:     <disk type="file" device="cdrom">
Oct 20 13:06:34 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 13:06:34 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config"/>
Oct 20 13:06:34 user nova-compute[74701]:       <target dev="hda" bus="ide"/>
Oct 20 13:06:34 user nova-compute[74701]:     </disk>
Oct 20 13:06:34 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:34 user nova-compute[74701]:       <mac address="fa:16:3e:43:6c:95"/>
Oct 20 13:06:34 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:34 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:34 user nova-compute[74701]:       <target dev="tap5bae838d-7e"/>
Oct 20 13:06:34 user nova-compute[74701]:     </interface>
Oct 20 13:06:34 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:34 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log" append="off"/>
Oct 20 13:06:34 user nova-compute[74701]:     </serial>
Oct 20 13:06:34 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:34 user nova-compute[74701]:     <video>
Oct 20 13:06:34 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:34 user nova-compute[74701]:     </video>
Oct 20 13:06:34 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:34 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:34 user nova-compute[74701]:     </rng>
Oct 20 13:06:34 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:34 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:34 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:34 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:34 user nova-compute[74701]:   </devices>
Oct 20 13:06:34 user nova-compute[74701]: </domain>
Oct 20 13:06:34 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG os_vif [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46aeb5e2-2252-5d26-929b-baa1b5bf820b', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bae838d-7e, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bae838d-7e, col_values=(('qos', UUID('3a560757-f578-4b06-8ebc-ba61de76e66f')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bae838d-7e, col_values=(('external_ids', {'iface-id': '5bae838d-7ebc-4362-bf9b-fd2b22dde080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:6c:95', 'vm-uuid': 'bdb0629d-0150-445c-b842-52a1c0ebbd41'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:34 user nova-compute[74701]: INFO os_vif [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e')
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name hda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No VIF found with MAC fa:16:3e:43:6c:95, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Using config drive
Oct 20 13:06:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Creating config drive at /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config
Oct 20 13:06:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7m1aps17 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7m1aps17" returned: 0 in 0.071s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-changed-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing instance network info cache due to event network-changed-5bae838d-7ebc-4362-bf9b-fd2b22dde080. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:34 user nova-compute[74701]: DEBUG nova.network.neutron [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing network info cache for port 5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Instance spawned successfully.
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:35 user nova-compute[74701]: INFO nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Took 11.12 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updated VIF entry in instance network info cache for port 5bae838d-7ebc-4362-bf9b-fd2b22dde080. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:35 user nova-compute[74701]: INFO nova.compute.manager [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Took 13.14 seconds to build instance.
Oct 20 13:06:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] No waiting events found dispatching network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:35 user nova-compute[74701]: WARNING nova.compute.manager [req-871a8d21-5a0c-4516-bf4f-a09d5e84f350 req-bc0b0b17-fcb2-4640-b662-a0681c293940 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received unexpected event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 for instance with vm_state building and task_state spawning.
Oct 20 13:06:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f929afa0-3049-4651-bc17-42458bee212c tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.380s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:06:36 user nova-compute[74701]: INFO nova.compute.claims [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Claim successful on node user
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:37 user nova-compute[74701]: WARNING nova.compute.manager [req-fe1d59ff-3e6a-427f-b9e3-7c55cc655c6e req-79b3c699-ce99-4129-89fb-e5f4853568d2 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 for instance with vm_state building and task_state spawning.
Oct 20 13:06:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.144s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:06:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:06:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG nova.policy [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099facfc8bbd44b4bb043c70c885fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de6880430d4533ac42bd43030b7b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:06:38 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Creating image(s)
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "/opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "/opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "/opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:38 user nova-compute[74701]: WARNING nova.compute.manager [req-1e42c363-0a66-4e39-a00f-e2f2b5d3c1bc req-cdf744d8-faa2-4651-af5a-f7584f7f38ff service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state None.
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.347s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.268s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:39 user nova-compute[74701]: WARNING nova.compute.manager [req-98d74fbd-4016-4f76-b910-6ceab25f92ec req-bf2cf425-2ebf-4c7d-81a0-63a461197c86 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 for instance with vm_state building and task_state spawning.
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Successfully created port: f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk 1073741824" returned: 0 in 0.128s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.281s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Cannot resize image /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:40 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Instance spawned successfully.
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:40 user nova-compute[74701]: INFO nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Took 9.59 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Successfully updated port: f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquired lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:06:40 user nova-compute[74701]: INFO nova.compute.manager [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Took 11.23 seconds to build instance.
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5baf4b02-8234-45f9-a9b7-32ddfc88cc0b tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.496s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:40 user nova-compute[74701]: WARNING nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state None.
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:40 user nova-compute[74701]: WARNING nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state None.
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:40 user nova-compute[74701]: WARNING nova.compute.manager [req-bd6b76d3-8807-4657-a46f-086ecca6c671 req-dc9d0e3d-633f-4892-9780-301a0f59975e service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state None.
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating instance_info_cache with network_info: [{"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Releasing lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Instance network_info: |[{"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Start _get_guest_xml network_info=[{"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:06:41 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:41 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1726226158',display_name='tempest-VolumesAssistedSnapshotsTest-server-1726226158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1726226158',id=8,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg18WU3BhbayL1aGnUknL+Y9rJCQY7u4aFut1/8pTEJTgB7tOHTtihISnwERBCYu2mdwl4Slht5Cehv6Qt05CxOSFmRGj/qlS+hpX/pTnrDDT7H5JjbCDWowIXgO2eo3Q==',key_name='tempest-keypair-1386769552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9de6880430d4533ac42bd43030b7b55',ramdisk_id='',reservation_id='r-2vi992d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-703313000',owner_user_name='tempest-VolumesAssistedSnapshotsTest-703313000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099facfc8bbd44b4bb043c70c885fe93',uuid=c01fac28-bf12-407e-a7a2-bc2a4ed68e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converting VIF {"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lazy-loading 'pci_devices' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:06:41 user nova-compute[74701]:   <uuid>c01fac28-bf12-407e-a7a2-bc2a4ed68e1c</uuid>
Oct 20 13:06:41 user nova-compute[74701]:   <name>instance-00000008</name>
Oct 20 13:06:41 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:06:41 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:06:41 user nova-compute[74701]:   <metadata>
Oct 20 13:06:41 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:06:41 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1726226158</nova:name>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:06:41</nova:creationTime>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:06:41 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:06:41 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:owner>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:user uuid="099facfc8bbd44b4bb043c70c885fe93">tempest-VolumesAssistedSnapshotsTest-703313000-project-member</nova:user>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:project uuid="b9de6880430d4533ac42bd43030b7b55">tempest-VolumesAssistedSnapshotsTest-703313000</nova:project>
Oct 20 13:06:41 user nova-compute[74701]:       </nova:owner>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:06:41 user nova-compute[74701]:       <nova:ports>
Oct 20 13:06:41 user nova-compute[74701]:         <nova:port uuid="f6ce411f-c69c-476b-8018-78ed8fc2c90a">
Oct 20 13:06:41 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:06:41 user nova-compute[74701]:         </nova:port>
Oct 20 13:06:41 user nova-compute[74701]:       </nova:ports>
Oct 20 13:06:41 user nova-compute[74701]:     </nova:instance>
Oct 20 13:06:41 user nova-compute[74701]:   </metadata>
Oct 20 13:06:41 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:06:41 user nova-compute[74701]:     <system>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="serial">c01fac28-bf12-407e-a7a2-bc2a4ed68e1c</entry>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="uuid">c01fac28-bf12-407e-a7a2-bc2a4ed68e1c</entry>
Oct 20 13:06:41 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:06:41 user nova-compute[74701]:     </system>
Oct 20 13:06:41 user nova-compute[74701]:   </sysinfo>
Oct 20 13:06:41 user nova-compute[74701]:   <os>
Oct 20 13:06:41 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:06:41 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:06:41 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:06:41 user nova-compute[74701]:   </os>
Oct 20 13:06:41 user nova-compute[74701]:   <features>
Oct 20 13:06:41 user nova-compute[74701]:     <acpi/>
Oct 20 13:06:41 user nova-compute[74701]:     <apic/>
Oct 20 13:06:41 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:06:41 user nova-compute[74701]:   </features>
Oct 20 13:06:41 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:06:41 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:06:41 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:06:41 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:06:41 user nova-compute[74701]:   </clock>
Oct 20 13:06:41 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:06:41 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:06:41 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:06:41 user nova-compute[74701]:   </cpu>
Oct 20 13:06:41 user nova-compute[74701]:   <devices>
Oct 20 13:06:41 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:06:41 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:06:41 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk"/>
Oct 20 13:06:41 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:06:41 user nova-compute[74701]:     </disk>
Oct 20 13:06:41 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:06:41 user nova-compute[74701]:       <mac address="fa:16:3e:31:f7:63"/>
Oct 20 13:06:41 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:41 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:06:41 user nova-compute[74701]:       <target dev="tapf6ce411f-c6"/>
Oct 20 13:06:41 user nova-compute[74701]:     </interface>
Oct 20 13:06:41 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:06:41 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/console.log" append="off"/>
Oct 20 13:06:41 user nova-compute[74701]:     </serial>
Oct 20 13:06:41 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:06:41 user nova-compute[74701]:     <video>
Oct 20 13:06:41 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:06:41 user nova-compute[74701]:     </video>
Oct 20 13:06:41 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:06:41 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:06:41 user nova-compute[74701]:     </rng>
Oct 20 13:06:41 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:06:41 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:06:41 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:06:41 user nova-compute[74701]:     </memballoon>
Oct 20 13:06:41 user nova-compute[74701]:   </devices>
Oct 20 13:06:41 user nova-compute[74701]: </domain>
Oct 20 13:06:41 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1726226158',display_name='tempest-VolumesAssistedSnapshotsTest-server-1726226158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1726226158',id=8,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg18WU3BhbayL1aGnUknL+Y9rJCQY7u4aFut1/8pTEJTgB7tOHTtihISnwERBCYu2mdwl4Slht5Cehv6Qt05CxOSFmRGj/qlS+hpX/pTnrDDT7H5JjbCDWowIXgO2eo3Q==',key_name='tempest-keypair-1386769552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9de6880430d4533ac42bd43030b7b55',ramdisk_id='',reservation_id='r-2vi992d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-703313000',owner_user_name='tempest-VolumesAssistedSnapshotsTest-703313000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099facfc8bbd44b4bb043c70c885fe93',uuid=c01fac28-bf12-407e-a7a2-bc2a4ed68e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converting VIF {"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG os_vif [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad1ea4c3-beb2-5894-af24-fb37efbb393e', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6ce411f-c6, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6ce411f-c6, col_values=(('qos', UUID('7c3635bb-c92a-44ed-bc59-14655ca3ebc7')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6ce411f-c6, col_values=(('external_ids', {'iface-id': 'f6ce411f-c69c-476b-8018-78ed8fc2c90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f7:63', 'vm-uuid': 'c01fac28-bf12-407e-a7a2-bc2a4ed68e1c'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:41 user nova-compute[74701]: INFO os_vif [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6')
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-changed-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Refreshing instance network info cache due to event network-changed-f6ce411f-c69c-476b-8018-78ed8fc2c90a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] Acquiring lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] Acquired lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Refreshing network info cache for port f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] No VIF found with MAC fa:16:3e:31:f7:63, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updated VIF entry in instance network info cache for port f6ce411f-c69c-476b-8018-78ed8fc2c90a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating instance_info_cache with network_info: [{"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a2e6fca-30d0-4914-91f5-3f57ca1b7303 req-a63c1f09-9b5c-4cf5-bc5d-edc66de6dc3b service nova] Releasing lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:06:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Instance spawned successfully.
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:06:45 user nova-compute[74701]: INFO nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Took 7.11 seconds to spawn the instance on the hypervisor.
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:45 user nova-compute[74701]: INFO nova.compute.manager [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Took 9.24 seconds to build instance.
Oct 20 13:06:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7728e9e0-518f-4fff-93b6-54638e8d5bce tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.474s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:06:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:06:51 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7928MB free_disk=25.53438949584961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] No waiting events found dispatching network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:51 user nova-compute[74701]: WARNING nova.compute.manager [req-decd098a-82e4-4ded-b75c-ce5eb324e077 req-f1c8097a-a8c0-4604-afe8-f5adc9d9c637 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received unexpected event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 for instance with vm_state active and task_state None.
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d5453469-c50d-41c0-a39b-a0d4d3add762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bdb0629d-0150-445c-b842-52a1c0ebbd41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:06:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:06:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] No waiting events found dispatching network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:54 user nova-compute[74701]: WARNING nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received unexpected event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 for instance with vm_state active and task_state None.
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] No waiting events found dispatching network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:54 user nova-compute[74701]: WARNING nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received unexpected event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 for instance with vm_state active and task_state None.
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] No waiting events found dispatching network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:54 user nova-compute[74701]: WARNING nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received unexpected event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 for instance with vm_state active and task_state None.
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] No waiting events found dispatching network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:54 user nova-compute[74701]: WARNING nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received unexpected event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a for instance with vm_state active and task_state None.
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] No waiting events found dispatching network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:06:54 user nova-compute[74701]: WARNING nova.compute.manager [req-034fa94c-cdd3-4ba3-93dc-e82eccc0f4b2 req-c0534c8c-836e-41cb-9d2d-7a0aac1cb2b5 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received unexpected event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a for instance with vm_state active and task_state None.
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating instance_info_cache with network_info: [{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:06:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:06:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:06:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:07:02 user nova-compute[74701]: INFO nova.compute.claims [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Claim successful on node user
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:07:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:07:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:07:03 user nova-compute[74701]: DEBUG nova.policy [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0429fbfe8ec14007b53153f70294e75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f284b2af22754158b35ab6e7b8182fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:07:03 user nova-compute[74701]: INFO nova.virt.block_device [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Booting with volume 8130bccf-b499-4013-a02e-294619154a38 at /dev/vda
Oct 20 13:07:03 user nova-compute[74701]: DEBUG os_brick.utils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:07:03 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpbonr9ngn/privsep.sock']
Oct 20 13:07:03 user sudo[85530]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpbonr9ngn/privsep.sock
Oct 20 13:07:03 user sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 13:07:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Successfully created port: 8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Successfully updated port: 8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquired lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:07:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating instance_info_cache with network_info: [{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Releasing lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance network_info: |[{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-changed-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Refreshing instance network info cache due to event network-changed-8e5d0654-5690-49ac-a149-0283de693b26. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] Acquiring lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] Acquired lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.network.neutron [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Refreshing network info cache for port 8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:05 user sudo[85530]: pam_unix(sudo:session): session closed for user root
Oct 20 13:07:05 user nova-compute[74701]: INFO oslo.privsep.daemon [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Spawned new privsep daemon via rootwrap
Oct 20 13:07:05 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 13:07:05 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 13:07:05 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 13:07:05 user nova-compute[74701]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85533
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf27720-ef15-4954-ae53-fc37bd1d6a14]: (2,) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.network.neutron [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updated VIF entry in instance network info cache for port 8e5d0654-5690-49ac-a149-0283de693b26. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.network.neutron [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating instance_info_cache with network_info: [{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-68700486-b648-49cb-805c-8088ec7e92d7 req-41b29ef6-6e00-401e-8aed-cc94bd970c68 service nova] Releasing lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc80880-a626-4262-b495-aeae07f608d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: WARNING os_brick.initiator.connectors.nvmeof [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e03fb5-cd50-4427-a460-f4625cc23d79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb10999-ef32-4bea-9ff5-2b982536028c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe27065-9f90-4d72-b77b-c0fbbcd958dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:05 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:07:05 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68ec15e-bf1d-4ea0-8aa1-b7ae725a13b7]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG os_brick.utils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== get_connector_properties: return (2074ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating existing volume attachment record: 6b9df8cd-f7c1-4af8-805e-ceb1e169adac {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:07:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:07:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Creating image(s)
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Ensure instance console log exists: /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start _get_guest_xml network_info=[{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd275ea5d-2ee8-4474-be60-57675370409f', 'attached_at': '', 'detached_at': '', 'volume_id': '8130bccf-b499-4013-a02e-294619154a38', 'serial': '8130bccf-b499-4013-a02e-294619154a38'}, 'attachment_id': '6b9df8cd-f7c1-4af8-805e-ceb1e169adac', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:07:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connector [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Factory for ISCSI on None {{(pid=74701) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:07:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:07:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:07:23 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ddb6e-4cef-45b5-89eb-e00d778a33da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:07:23 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5a64e-88f1-4c21-8754-911bf7bc64ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38] added
Oct 20 13:07:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[84465b7c-9027-4c5d-9c78-b868ef80d0b4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8b8fd-6cb5-4e89-88af-5434c7b051a5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYSPkqax {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYSPkqax" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fb585-d51c-4399-8afa-0c885b3b1afd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYSPkqax'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8036d-4552-4163-9449-62563a1e3cd1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aca40c-f6ce-4ff4-bfd7-b33137fca115]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:07:23 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:07:23 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:07:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:07:23 user nova-compute[74701]: 
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334cad5-37ed-4c9d-b9a2-32161eb4e364]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]
Oct 20 13:07:23 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.
Oct 20 13:07:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155b65d-c82d-46f2-b58a-d4c0b378c21a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c24b0a-23dd-46a7-b7d8-d1633505150d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:07:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:07:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef78d9-7e16-4acf-9f5f-915f20d8b407]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:07:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26631616163326366', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631616163326366', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1631351501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lazy-loading 'pci_devices' on Instance uuid d275ea5d-2ee8-4474-be60-57675370409f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:07:24 user nova-compute[74701]:   <uuid>d275ea5d-2ee8-4474-be60-57675370409f</uuid>
Oct 20 13:07:24 user nova-compute[74701]:   <name>instance-00000009</name>
Oct 20 13:07:24 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:07:24 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:07:24 user nova-compute[74701]:   <metadata>
Oct 20 13:07:24 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:07:24 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:07:24 user nova-compute[74701]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1631351501</nova:name>
Oct 20 13:07:24 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:07:23</nova:creationTime>
Oct 20 13:07:24 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:07:24 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:07:24 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:07:24 user nova-compute[74701]:       <nova:owner>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:user uuid="0429fbfe8ec14007b53153f70294e75d">tempest-ServerActionsV293TestJSON-1180019451-project-member</nova:user>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:project uuid="f284b2af22754158b35ab6e7b8182fef">tempest-ServerActionsV293TestJSON-1180019451</nova:project>
Oct 20 13:07:24 user nova-compute[74701]:       </nova:owner>
Oct 20 13:07:24 user nova-compute[74701]:       <nova:ports>
Oct 20 13:07:24 user nova-compute[74701]:         <nova:port uuid="8e5d0654-5690-49ac-a149-0283de693b26">
Oct 20 13:07:24 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:07:24 user nova-compute[74701]:         </nova:port>
Oct 20 13:07:24 user nova-compute[74701]:       </nova:ports>
Oct 20 13:07:24 user nova-compute[74701]:     </nova:instance>
Oct 20 13:07:24 user nova-compute[74701]:   </metadata>
Oct 20 13:07:24 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:07:24 user nova-compute[74701]:     <system>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="serial">d275ea5d-2ee8-4474-be60-57675370409f</entry>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="uuid">d275ea5d-2ee8-4474-be60-57675370409f</entry>
Oct 20 13:07:24 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:07:24 user nova-compute[74701]:     </system>
Oct 20 13:07:24 user nova-compute[74701]:   </sysinfo>
Oct 20 13:07:24 user nova-compute[74701]:   <os>
Oct 20 13:07:24 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:07:24 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:07:24 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:07:24 user nova-compute[74701]:   </os>
Oct 20 13:07:24 user nova-compute[74701]:   <features>
Oct 20 13:07:24 user nova-compute[74701]:     <acpi/>
Oct 20 13:07:24 user nova-compute[74701]:     <apic/>
Oct 20 13:07:24 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:07:24 user nova-compute[74701]:   </features>
Oct 20 13:07:24 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:07:24 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:07:24 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:07:24 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:07:24 user nova-compute[74701]:   </clock>
Oct 20 13:07:24 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:07:24 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:07:24 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:07:24 user nova-compute[74701]:   </cpu>
Oct 20 13:07:24 user nova-compute[74701]:   <devices>
Oct 20 13:07:24 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:07:24 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:07:24 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:07:24 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:07:24 user nova-compute[74701]:       <serial>8130bccf-b499-4013-a02e-294619154a38</serial>
Oct 20 13:07:24 user nova-compute[74701]:     </disk>
Oct 20 13:07:24 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:07:24 user nova-compute[74701]:       <mac address="fa:16:3e:2d:d9:6a"/>
Oct 20 13:07:24 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:07:24 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:07:24 user nova-compute[74701]:       <target dev="tap8e5d0654-56"/>
Oct 20 13:07:24 user nova-compute[74701]:     </interface>
Oct 20 13:07:24 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:07:24 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f/console.log" append="off"/>
Oct 20 13:07:24 user nova-compute[74701]:     </serial>
Oct 20 13:07:24 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:07:24 user nova-compute[74701]:     <video>
Oct 20 13:07:24 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:07:24 user nova-compute[74701]:     </video>
Oct 20 13:07:24 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:07:24 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:07:24 user nova-compute[74701]:     </rng>
Oct 20 13:07:24 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:07:24 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:07:24 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:07:24 user nova-compute[74701]:     </memballoon>
Oct 20 13:07:24 user nova-compute[74701]:   </devices>
Oct 20 13:07:24 user nova-compute[74701]: </domain>
Oct 20 13:07:24 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1631351501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG os_vif [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ab0ecef-266e-599b-9e7f-9ef69cebbc61', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e5d0654-56, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e5d0654-56, col_values=(('qos', UUID('a8ff1c28-7980-4e6d-a5a9-9f3b6f54406c')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e5d0654-56, col_values=(('external_ids', {'iface-id': '8e5d0654-5690-49ac-a149-0283de693b26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:d9:6a', 'vm-uuid': 'd275ea5d-2ee8-4474-be60-57675370409f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:24 user nova-compute[74701]: INFO os_vif [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56')
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:07:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] No VIF found with MAC fa:16:3e:2d:d9:6a, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:26 user nova-compute[74701]: WARNING nova.compute.manager [req-43fec823-2395-45ee-8996-d5a319799102 req-918c4cd2-6057-47ef-bd3b-fa26f15bf06a service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state building and task_state spawning.
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:07:28 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance spawned successfully.
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:28 user nova-compute[74701]: WARNING nova.compute.manager [req-ed95d417-6cdd-4634-9627-dc30eaa208fe req-1df882bc-a9c8-4ede-9a89-c8e53a99bea9 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state building and task_state spawning.
Oct 20 13:07:28 user nova-compute[74701]: INFO nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 20 13:07:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:07:28 user nova-compute[74701]: INFO nova.compute.manager [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Took 26.27 seconds to build instance.
Oct 20 13:07:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5a60b9f9-8dc8-4ac8-ad99-e626b3e894d0 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.401s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:34 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:07:34 user nova-compute[74701]: INFO nova.compute.claims [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Claim successful on node user
Oct 20 13:07:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:07:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:07:35 user nova-compute[74701]: INFO nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Booting with volume cda19f5d-0905-4802-a806-545f25ab9380 at /dev/vda
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.policy [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5e1413023154e23bd8a99fa5ab17836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313a39d5426941ec816042fe52a8e544', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[100b81e8-d3b4-4eba-bfe7-b8b9a8a498d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89ec02-2df7-4b95-9b43-732d00aa3777]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b5271c-70ef-4250-b44a-c48f4e5707d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c2bb2-8d31-42c9-929f-ba8b0e3b3e58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:35 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:07:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e710a6-d235-4389-b66e-56e0124e09f5]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating existing volume attachment record: ac7ac2e1-009c-4ead-9ca6-b91b9eb5ad62 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:07:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully created port: e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully created port: d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully created port: 7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully created port: 2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully created port: 0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-e8b7060d-22e1-4259-81f0-e1be95abc54b. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95bdbd78-5356-4963-9edd-20be959d9ab0 req-068e7829-4569-4747-a0ae-6009236213d8 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: 5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-a1328795-0748-42ec-a6f4-4e87389cb271. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:40 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-5ee9a45a-c431-47d6-849d-2313a7b27afd. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port 5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: 7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5d99e2-560a-410f-be75-93c33bfca335 req-74e42724-21b2-43e7-bde0-69bb86ae2f5c service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: 2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Successfully updated port: 0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-d14d71af-e9c3-4c50-93af-9dae07eb843d. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.network.neutron [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance network_info: |[{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updated VIF entry in instance network info cache for port d14d71af-e9c3-4c50-93af-9dae07eb843d. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-7d5bd3cf-c4ee-463a-9c90-f51022ff5013. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:44 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port 7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updated VIF entry in instance network info cache for port 7d5bd3cf-c4ee-463a-9c90-f51022ff5013. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-2c6ffd26-46fa-48e4-8a9e-c992870b08a7. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port 2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updated VIF entry in instance network info cache for port 2c6ffd26-46fa-48e4-8a9e-c992870b08a7. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-0b35cd52-4089-47c0-9042-1a5edee5913f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port 0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updated VIF entry in instance network info cache for port 0b35cd52-4089-47c0-9042-1a5edee5913f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-94460342-a628-40f1-96c9-f02734ee37e9 req-8e83684a-4f66-4e10-a8fa-1cb9de4422d5 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:07:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:07:49 user nova-compute[74701]: INFO nova.compute.claims [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Claim successful on node user
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:49 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:07:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:07:50 user nova-compute[74701]: INFO nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Booting with volume 572c85ea-c3b3-47dd-b54f-daf5f12c3668 at /dev/vda
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.policy [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81217338ece64953b1869c69ba9fe8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd210ff985ac9417ebd810027ce595cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135b39f-6b28-4723-8806-7190a6084790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56963f3-1548-4483-9ff5-7cfdc0fce7eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad82527-ce6a-4271-9e49-fa98e0c4674b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad202f-6f0b-4781-8c92-a7947b11f005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:50 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[179add8e-8ecf-4dbb-8030-2da3cf004a05]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating existing volume attachment record: 562ce7a8-b582-476b-9eb6-aecf446c8e37 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully created port: 66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:50 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:50 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7172MB free_disk=25.410804748535156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bdb0629d-0150-445c-b842-52a1c0ebbd41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5b925b2-8341-4f1f-99d0-4a27ce9efe1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d5453469-c50d-41c0-a39b-a0d4d3add762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:07:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully created port: ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-changed-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Refreshing instance network info cache due to event network-changed-8a6e31c1-6831-440c-b25b-732eece5dfa5. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] Acquiring lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] Acquired lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Refreshing network info cache for port 8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully created port: b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:52 user nova-compute[74701]: INFO nova.compute.manager [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Rescuing
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updated VIF entry in instance network info cache for port 8a6e31c1-6831-440c-b25b-732eece5dfa5. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating instance_info_cache with network_info: [{"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9d02c4e6-a495-41f0-9a29-f11ad7daf828 req-d2c29c55-93a8-436e-9ac6-eddf4ba4c1d9 service nova] Releasing lock "refresh_cache-d8e28db3-6b19-459f-b314-09ede99f9c8d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully created port: ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully created port: a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:53 user nova-compute[74701]: WARNING nova.compute.manager [req-1c6945d6-0812-4387-937f-b156c2a6477c req-44a9e7b9-9c28-4bb3-a788-68c899057f0f service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state rescuing.
Oct 20 13:07:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance destroyed successfully.
Oct 20 13:07:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Attempting rescue
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74701) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:07:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Creating image(s)
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: 66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-66432bbd-7941-4c6a-ab87-da0374b16c4c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port 66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue" returned: 0 in 0.075s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'migration_context' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<0fd5f037-78df-4001-97b6-d4fec57b87d5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start _get_guest_xml network_info=[{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:f0:91:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<0fd5f037-78df-4001-97b6-d4fec57b87d5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<0fd5f037-78df-4001-97b6-d4fec57b87d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:07:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-055e6d24-563a-41a3-a3fc-21c74e6d58ad req-486ff8b0-54c3-4355-8acc-a0d6c99db584 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<0fd5f037-78df-4001-97b6-d4fec57b87d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397688832',display_name='tempest-ServerRescueNegativeTestJSON-server-1397688832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397688832',id=3,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-vbunpiby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:20Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=0fd5f037-78df-4001-97b6-d4fec57b87d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:f0:91:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:f0:91:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<0fd5f037-78df-4001-97b6-d4fec57b87d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:07:54 user nova-compute[74701]:   <uuid>0fd5f037-78df-4001-97b6-d4fec57b87d5</uuid>
Oct 20 13:07:54 user nova-compute[74701]:   <name>instance-00000003</name>
Oct 20 13:07:54 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:07:54 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:07:54 user nova-compute[74701]:   <metadata>
Oct 20 13:07:54 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:07:54 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397688832</nova:name>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:07:54</nova:creationTime>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:07:54 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:07:54 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:owner>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:07:54 user nova-compute[74701]:       </nova:owner>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:07:54 user nova-compute[74701]:       <nova:ports>
Oct 20 13:07:54 user nova-compute[74701]:         <nova:port uuid="dceb5cbd-d231-44b8-95fd-a2693ee7831a">
Oct 20 13:07:54 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:07:54 user nova-compute[74701]:         </nova:port>
Oct 20 13:07:54 user nova-compute[74701]:       </nova:ports>
Oct 20 13:07:54 user nova-compute[74701]:     </nova:instance>
Oct 20 13:07:54 user nova-compute[74701]:   </metadata>
Oct 20 13:07:54 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:07:54 user nova-compute[74701]:     <system>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="serial">0fd5f037-78df-4001-97b6-d4fec57b87d5</entry>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="uuid">0fd5f037-78df-4001-97b6-d4fec57b87d5</entry>
Oct 20 13:07:54 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:07:54 user nova-compute[74701]:     </system>
Oct 20 13:07:54 user nova-compute[74701]:   </sysinfo>
Oct 20 13:07:54 user nova-compute[74701]:   <os>
Oct 20 13:07:54 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:07:54 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:07:54 user nova-compute[74701]:   </os>
Oct 20 13:07:54 user nova-compute[74701]:   <features>
Oct 20 13:07:54 user nova-compute[74701]:     <acpi/>
Oct 20 13:07:54 user nova-compute[74701]:     <apic/>
Oct 20 13:07:54 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:07:54 user nova-compute[74701]:   </features>
Oct 20 13:07:54 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:07:54 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:07:54 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:07:54 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:07:54 user nova-compute[74701]:   </clock>
Oct 20 13:07:54 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:07:54 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:07:54 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:07:54 user nova-compute[74701]:   </cpu>
Oct 20 13:07:54 user nova-compute[74701]:   <devices>
Oct 20 13:07:54 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:07:54 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:07:54 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue"/>
Oct 20 13:07:54 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:07:54 user nova-compute[74701]:     </disk>
Oct 20 13:07:54 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:07:54 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:07:54 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk"/>
Oct 20 13:07:54 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:07:54 user nova-compute[74701]:     </disk>
Oct 20 13:07:54 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:07:54 user nova-compute[74701]:       <mac address="fa:16:3e:f0:91:6b"/>
Oct 20 13:07:54 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:07:54 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:07:54 user nova-compute[74701]:       <target dev="tapdceb5cbd-d2"/>
Oct 20 13:07:54 user nova-compute[74701]:     </interface>
Oct 20 13:07:54 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:07:54 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/console.log" append="off"/>
Oct 20 13:07:54 user nova-compute[74701]:     </serial>
Oct 20 13:07:54 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:07:54 user nova-compute[74701]:     <video>
Oct 20 13:07:54 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:07:54 user nova-compute[74701]:     </video>
Oct 20 13:07:54 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:07:54 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:07:54 user nova-compute[74701]:     </rng>
Oct 20 13:07:54 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:07:54 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:07:54 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:07:54 user nova-compute[74701]:     </memballoon>
Oct 20 13:07:54 user nova-compute[74701]:   </devices>
Oct 20 13:07:54 user nova-compute[74701]: </domain>
Oct 20 13:07:54 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:07:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance destroyed successfully.
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:f0:91:6b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: 8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:55 user nova-compute[74701]: WARNING nova.compute.manager [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state rescuing.
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-changed-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Refreshing instance network info cache due to event network-changed-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Acquiring lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Acquired lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Refreshing network info cache for port b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port 8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updated VIF entry in instance network info cache for port b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating instance_info_cache with network_info: [{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fa990b62-030d-42ce-8d15-4fd52577e9a1 req-23a9a310-9c04-4d4a-8be8-f1d43310f596 service nova] Releasing lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-d54532ea-fdfc-47b2-9125-f80a90a56046. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8c7a1759-169b-49b6-95c6-0753ce87e7eb req-dca63e9f-213d-470d-8953-3530809eba46 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:07:56 user nova-compute[74701]: INFO nova.compute.manager [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] instance snapshotting
Oct 20 13:07:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Beginning live snapshot process
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:57 user nova-compute[74701]: WARNING nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state rescuing.
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:07:57 user nova-compute[74701]: WARNING nova.compute.manager [req-2fc4b8e9-3253-4287-9e83-5402cb5e39a5 req-8de26fba-7c7a-44be-8a65-2ee0f9184801 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state active and task_state rescuing.
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-ea1166c4-57e2-4f09-acf1-4e026c0a847f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea.delta 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea.delta 1073741824" returned: 0 in 0.055s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Successfully updated port: a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74701) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 13:07:58 user nova-compute[74701]: INFO nova.virt.libvirt.host [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] UEFI support detected
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-b503c659-a651-41a0-bed4-592c91f6bea9. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:58 user nova-compute[74701]: INFO nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Booting with volume 12fb63a6-b752-4981-9def-1ed105e6593c at /dev/vdb
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-2ff8e7a2-6e9a-47ad-80c5-f73e250d2651 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcfcaae-31f0-468d-99bc-fb3451897e6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3529c11-33c9-4f74-967e-26e15b2fdd8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d99b23-d9df-4e62-ba6e-b010a2ec191e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aff4a1-4544-4152-82bb-66b02aac181e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:07:58 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e23d908-1896-4c7d-8620-af3ec1b55b31]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating existing volume attachment record: ddb1a775-bfc0-43d7-84b3-aa4c181cbde8 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-ad025839-f8cd-41da-9ac8-4014d6e6e408. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a76cd44b-2691-4b2d-80eb-2e931e0ecbce req-37751c51-0960-400c-97f3-ef4d5edd6775 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:07:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:07:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:07:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:07:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:07:59 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 13:07:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:07:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-a1234d8f-4aef-4b5d-9d45-df89de104b96. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:07:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:00 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:08:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea.delta /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea.delta /opt/stack/data/nova/instances/snapshots/tmpfhr64iz5/b4eeadf7e21b471db9c8ba900beaddea" returned: 0 in 0.901s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Snapshot extracted, beginning image upload
Oct 20 13:08:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance network_info: |[{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updated VIF entry in instance network info cache for port a1234d8f-4aef-4b5d-9d45-df89de104b96. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bddd4626-3f1e-4f08-b5ee-1931b20e2fad req-ee084e57-d656-4462-bd01-17104f67cbd3 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Snapshot image upload complete
Oct 20 13:08:03 user nova-compute[74701]: INFO nova.compute.manager [None req-387531ac-2722-4d55-ad9d-0fb9fe0e438d tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Took 6.85 seconds to snapshot the instance on the hypervisor.
Oct 20 13:08:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:05 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:06 user nova-compute[74701]: INFO nova.compute.manager [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Attaching volume 00b5ee96-5d84-4886-8059-3df43a5bfab5 to /dev/vdb
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.utils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e88126-f76d-4054-bc2c-ddf17b807dfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3862ee-d821-4c19-b60f-a98399c17d7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e5f70-b42f-4597-a935-2ecd1e94ad97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc796e1-be41-45f7-97d8-0ca4edc78c05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:06 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a5b7d-8edb-4a45-9a91-03ce184aefb2]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG os_brick.utils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:06 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating existing volume attachment record: 1a2dffee-faec-47b8-a79d-8c16e07d19b7 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-changed-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Refreshing instance network info cache due to event network-changed-038c3665-0c3f-4ebb-b170-e3764a313137. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] Acquiring lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] Acquired lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Refreshing network info cache for port 038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updated VIF entry in instance network info cache for port 038c3665-0c3f-4ebb-b170-e3764a313137. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-826d727f-f138-4dc5-b74e-6b00dfa3f430 req-c26a201b-d041-4445-aaff-0458bc90cfa9 service nova] Releasing lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:09 user nova-compute[74701]: INFO nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Booting with volume aed2534f-14af-4e54-8235-42393831134b at /dev/vdb
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf110be-732f-4b51-84bd-c8acb1a521d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff7f5ce-7634-4a55-a0e8-fef7b4283905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2a4db-b553-4325-be74-1259aa9c32ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ec233-d6b0-402a-bb72-03829fb45b79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:10 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1540b8c-c7a5-45b0-b514-6c677be70a2b]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating existing volume attachment record: ef1caa30-af12-4d51-8319-331fc0425325 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-changed-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Refreshing instance network info cache due to event network-changed-f3292852-36fd-437d-bd66-28f5403e3cf4. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] Acquiring lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] Acquired lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Refreshing network info cache for port f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updated VIF entry in instance network info cache for port f3292852-36fd-437d-bd66-28f5403e3cf4. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updating instance_info_cache with network_info: [{"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d0df1b2-fef0-4fa6-8af4-ec141561fdc4 req-7614f053-9782-4161-907c-5120d2371989 service nova] Releasing lock "refresh_cache-d5453469-c50d-41c0-a39b-a0d4d3add762" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-changed-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing instance network info cache due to event network-changed-5bae838d-7ebc-4362-bf9b-fd2b22dde080. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing network info cache for port 5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.network.neutron [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updated VIF entry in instance network info cache for port 5bae838d-7ebc-4362-bf9b-fd2b22dde080. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.network.neutron [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-565998d0-6142-442d-be0f-1309cc0451fc req-090d3a9b-f38b-4dec-9a69-22869e5b32d3 service nova] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'pci_requests' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.objects.base [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Object Instance<bdb0629d-0150-445c-b842-52a1c0ebbd41> lazy-loaded attributes: flavor,pci_requests {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:08:21 user nova-compute[74701]: DEBUG nova.policy [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3350fab957a47ea9f835198cbd20119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7907705534cadabf146dd7de662d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:08:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Successfully created port: 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Successfully updated port: 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-changed-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing instance network info cache due to event network-changed-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Refreshing network info cache for port 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG os_vif [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '307abcea-9e55-505c-b689-a55e5566ed8e', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a30e219-d6, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a30e219-d6, col_values=(('qos', UUID('e587d535-994a-451f-88fc-14f4513e94e9')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a30e219-d6, col_values=(('external_ids', {'iface-id': '9a30e219-d69f-40ef-8dd7-452ad5cc0e5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:da:4e', 'vm-uuid': 'bdb0629d-0150-445c-b842-52a1c0ebbd41'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: INFO os_vif [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6')
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] attach device xml: <interface type="ethernet">
Oct 20 13:08:24 user nova-compute[74701]:   <mac address="fa:16:3e:34:da:4e"/>
Oct 20 13:08:24 user nova-compute[74701]:   <model type="virtio"/>
Oct 20 13:08:24 user nova-compute[74701]:   <mtu size="1442"/>
Oct 20 13:08:24 user nova-compute[74701]:   <target dev="tap9a30e219-d6"/>
Oct 20 13:08:24 user nova-compute[74701]: </interface>
Oct 20 13:08:24 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name hda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No VIF found with MAC fa:16:3e:43:6c:95, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:08:25 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:08:25</nova:creationTime>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:08:25 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:08:25 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:owner>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:08:25 user nova-compute[74701]:   </nova:owner>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:08:25 user nova-compute[74701]:   <nova:ports>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:08:25 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:08:25 user nova-compute[74701]:     </nova:port>
Oct 20 13:08:25 user nova-compute[74701]:     <nova:port uuid="9a30e219-d69f-40ef-8dd7-452ad5cc0e5c">
Oct 20 13:08:25 user nova-compute[74701]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Oct 20 13:08:25 user nova-compute[74701]:     </nova:port>
Oct 20 13:08:25 user nova-compute[74701]:   </nova:ports>
Oct 20 13:08:25 user nova-compute[74701]: </nova:instance>
Oct 20 13:08:25 user nova-compute[74701]:  {{(pid=74701) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc127d0b-537b-46eb-ab64-ea09327b794c tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.839s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updated VIF entry in instance network info cache for port 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f97032c8-13bb-48dd-b339-957fc7bbdb3b req-5ff578ce-c24f-4890-ab92-2344dd81d158 service nova] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:08:25 user nova-compute[74701]: WARNING nova.compute.manager [req-5ec5e1ed-2f9e-40ef-af6c-5fb5fdb2d258 req-0b598d8d-a25b-448f-b2e0-9f7e79b3b366 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c for instance with vm_state active and task_state None.
Oct 20 13:08:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:27 user nova-compute[74701]: INFO nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Booting with volume 7f86708c-5e83-496a-bd06-b2281e0d2ab9 at /dev/vdc
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'flavor' on Instance uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lazy-loading 'flavor' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf2d17-8d51-4993-854d-e9683b71ec72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b17a7c4-8223-46a3-b106-8c1237b41adb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b124a-6b5e-46f7-a0b1-05670829b9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b3cac6-fb2b-4d88-b082-98d4ec818809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:27 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe1475a-5d0e-41f7-850e-92573287ebea]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG os_brick.utils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating existing volume attachment record: 22e3134b-0023-4418-bcae-24e936f2a076 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: INFO nova.compute.manager [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Attaching volume 93150aa6-6b19-403f-af61-25ef72c8be68 to /dev/vdb
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:08:27 user nova-compute[74701]: WARNING nova.compute.manager [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c for instance with vm_state active and task_state None.
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-changed-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Refreshing instance network info cache due to event network-changed-f6ce411f-c69c-476b-8018-78ed8fc2c90a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Acquiring lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Acquired lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Refreshing network info cache for port f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:27 user nova-compute[74701]: INFO nova.compute.manager [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Attaching volume 5bc5a489-0923-441b-8f96-e76c10c72414 to /dev/vdb
Oct 20 13:08:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updated VIF entry in instance network info cache for port f6ce411f-c69c-476b-8018-78ed8fc2c90a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating instance_info_cache with network_info: [{"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7567eb56-b4bc-4378-b499-6d7ac973860a req-219faf42-1641-4726-a60e-710bf61b7b0f service nova] Releasing lock "refresh_cache-c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:29 user nova-compute[74701]: INFO nova.compute.manager [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Attaching volume 2a8d807a-1a26-4c85-b1cf-9a8549f79034 to /dev/vdb
Oct 20 13:08:30 user nova-compute[74701]: INFO nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Booting with volume 1f39f17b-884a-4717-acee-b137ca974d86 at /dev/vdc
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00b16c-a500-4281-a0de-d18928ac4c7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab1adb-1d99-4a98-a195-2b98d6b8aaff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8580ea7-18a6-46d9-98ca-81409ed04f73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a3078-a91e-41da-bd9e-485499bedfda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a05b84-00dd-4cd7-80ef-995e3d04bd15]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating existing volume attachment record: f9ec517d-5991-4aeb-965f-a0a9a207d364 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a8954-d52b-4d42-bc1a-82adf2c20bf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d604298-9ee3-4f15-9fca-5b5159f769d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f23256-28d4-41da-8d84-0719564c0265]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc76d2-c9c7-49e6-a1f0-dd84e8de72f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba4c680-85c4-4b0c-ab08-f4b32d86a313]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[662597ce-e8bc-4030-ae68-d979e866298f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cf668b-4e48-4345-98b1-1ca01d443f51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce939c09-bfca-434c-a7a6-af8fde226831]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating existing volume attachment record: 0b9723cc-cbca-4d35-ad97-3c7f311505a5 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[519bcc80-91c1-44c2-86b1-9b5395129a80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a6025-eef0-4d85-b1ab-98d3027ed847]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf29d9-874d-423f-9cf3-1b6579c6699b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[921af5b0-9aef-4b29-9c43-59eb566da1e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b12f2-d279-47da-a650-6148d8cd47b9]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[29272aee-0b26-40d3-9169-c61d4fbf7c08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating existing volume attachment record: 50b69332-e5cd-4ec5-b562-8d2fb6aed89d {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:30 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:30 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b53426-4922-4b44-b2e3-41ddc17d03a1]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG os_brick.utils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating existing volume attachment record: 339cf243-a40f-4944-ae95-6e54aa35d49a {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeHBUown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:31 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:31 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:31 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79eda71-373b-47e0-a89b-f093af69cc8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:31 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c89553-ff71-4e80-b7fb-fdf5438fb635]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5] added
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6317cdd-fe24-43d1-8ab1-336ab5964216]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec0d56-2f87-4bab-8a18-0c16e37ca0b6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeHBUown {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeHBUown" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f501d15-6679-4d08-ada2-f0cc2605b116]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeHBUown'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e530e-b885-48d2-851a-5918e8309e7d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7313f229-2fd2-4fbc-bd5e-687d3de157b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48c6582-da3c-467d-8152-4646225a2b67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260]
Oct 20 13:08:31 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[47612f1f-816f-40f2-a11c-44444356366d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7667a-3969-4337-9a48-453dc83a3b8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fd2a21-2816-4061-8211-eab1a78ef9d8]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeHBUown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26363613563633834', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363613563633834', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:32 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:08:32 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:32 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:08:32 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:08:32 user nova-compute[74701]:   <serial>00b5ee96-5d84-4886-8059-3df43a5bfab5</serial>
Oct 20 13:08:32 user nova-compute[74701]: </disk>
Oct 20 13:08:32 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:08:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:4b:be:64, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKwnzNkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:49 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:49 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6f8e7-8d13-437b-9ad9-d5ae279895a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:49 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b4f4e-6334-4f1f-9d4a-2cacd203f0e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68] added
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5395415d-9c1e-46b1-a872-276690808837]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24898fd-e14a-4b94-9090-6ff63233e161]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKwnzNkP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKwnzNkP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece424c3-06eb-46e7-983f-53ab223d0253]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKwnzNkP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1073248-b13a-446b-9fb0-b95ba582eb99]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a35f5-f928-4b74-9b13-84e164f55d89]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b70159-8308-43da-944b-fff2478ee212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260]
Oct 20 13:08:49 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f103eb-bb22-4efd-8191-9549200f1c59]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[764783bf-47b7-4a8c-8baa-5cad2dcd5323]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c829d6-4d90-4a47-ab5c-7097b2f0897c]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKwnzNkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJzMCPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:50 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26332323265653639', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323265653639', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.053s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:50 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:50 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'flavor' on Instance uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad7477-40bd-475d-a21a-449e92e31064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:50 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7cd7d-0038-4fdc-bb69-f75198684fa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414] added
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:08:50 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:50 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:08:50 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:08:50 user nova-compute[74701]:   <serial>93150aa6-6b19-403f-af61-25ef72c8be68</serial>
Oct 20 13:08:50 user nova-compute[74701]: </disk>
Oct 20 13:08:50 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1671c574-bc5f-417c-a55b-dace1cb3e80d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c7ba3-f5d9-447d-a033-a46bf1e94d68]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANJzMCPy {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANJzMCPy" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b41491-6c07-422a-a2e3-24d85da78304]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANJzMCPy'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8bfe7c-b991-499d-8992-8f5f4e456215]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d9e97-40b3-4f17-82fe-16b6e9dd8e45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bb5bf-6d3a-46fa-867d-8eed5ed357f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260]
Oct 20 13:08:50 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c975244-54b5-4217-ba6c-7afb11d5b094]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee068c88-dcb9-4bfd-85aa-47c1baabfe63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b19ab-0f53-4108-ae84-fb4fc7c24731]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJzMCPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No VIF found with MAC fa:16:3e:2c:53:84, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0b98055a-7982-416f-b2a7-8bbf2b9652a0 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.960s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.360s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:08:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Creating image(s)
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Ensure instance console log exists: /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Start _get_guest_xml network_info=[{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHwsFyWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71b23879-5dfd-44df-b6ca-6abad87aefa3', 'attached_at': '', 'detached_at': '', 'volume_id': 'cda19f5d-0905-4802-a806-545f25ab9380', 'serial': 'cda19f5d-0905-4802-a806-545f25ab9380'}, 'attachment_id': 'ac7ac2e1-009c-4ead-9ca6-b91b9eb5ad62', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUazujqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71b23879-5dfd-44df-b6ca-6abad87aefa3', 'attached_at': '', 'detached_at': '', 'volume_id': '12fb63a6-b752-4981-9def-1ed105e6593c', 'serial': '12fb63a6-b752-4981-9def-1ed105e6593c'}, 'attachment_id': 'ddb1a775-bfc0-43d7-84b3-aa4c181cbde8', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsutmynR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71b23879-5dfd-44df-b6ca-6abad87aefa3', 'attached_at': '', 'detached_at': '', 'volume_id': '7f86708c-5e83-496a-bd06-b2281e0d2ab9', 'serial': '7f86708c-5e83-496a-bd06-b2281e0d2ab9'}, 'attachment_id': '22e3134b-0023-4418-bcae-24e936f2a076', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.objects.instance [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lazy-loading 'flavor' on Instance uuid d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23935633333303738', 'path': '/dev/sde'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935633333303738', 'path': '/dev/sde'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6088a628-80f9-4397-810f-6ff8731e8e78 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.970s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHwsFyWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:51 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.objects.instance [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2607693a-7ceb-4af5-94f6-f05bb8b28cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:51 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:08:51 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:51 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:08:51 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:08:51 user nova-compute[74701]:   <serial>5bc5a489-0923-441b-8f96-e76c10c72414</serial>
Oct 20 13:08:51 user nova-compute[74701]: </disk>
Oct 20 13:08:51 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fdd796-d40b-45c2-87fd-4165c424b7e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380] added
Oct 20 13:08:51 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4918ee66-98ab-4273-b597-edad4d25d158]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a7d33-8555-4427-b399-c1e8832a309c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHwsFyWv {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHwsFyWv" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[203bba9f-8170-4d69-a690-cd37464d19b9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aHwsFyWv'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94fea5d-e5cc-4058-b9cb-97167a7112da]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3745ef-2e49-47b1-bef0-c847d285b42e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[07155711-3903-49c1-a1d1-a93fcde93d7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260]
Oct 20 13:08:52 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2a187-8bd1-494b-910c-0a3fdd0066be]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c98aab-d3c3-430f-9258-2dd326c371fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d7066a-371e-44b1-821b-bf5e15d1af26]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHwsFyWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:52 user nova-compute[74701]: INFO nova.compute.manager [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Attaching volume 8af1fc40-0463-44e6-a3c7-745fa05c17fd to /dev/sdc
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No BDM found with device name hda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] No VIF found with MAC fa:16:3e:43:6c:95, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-caa366f0-9fea-460f-b24d-aaac22fb6530 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.905s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.utils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23936343035333437', 'path': '/dev/sdf'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936343035333437', 'path': '/dev/sdf'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7486MB free_disk=25.348628997802734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[12537e63-ff49-450e-95d8-b672ab99ffe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUazujqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:53 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca91e3-6244-422a-a1af-c8b4907618eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98169692-d4f2-4562-b29c-c1aca97c2c52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:53 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341e6d3-10dc-4f0d-b782-f9cae5097fda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[65396818-1735-422a-8512-b3fc0156fe8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c] added
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0fc9b4-606f-46d7-943d-9a316fc22386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-changed-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Refreshing instance network info cache due to event network-changed-8e5d0654-5690-49ac-a149-0283de693b26. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] Acquiring lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] Acquired lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Refreshing network info cache for port 8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[919acefc-66d2-4afa-beed-95fa6d02f8bc]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:08:53 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[645e5ffe-baa1-4940-81ac-635a07a4624e]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.utils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] <== get_connector_properties: return (225ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updating existing volume attachment record: 5327e66d-bbef-43b2-aa3d-75a62644c281 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1156e3-20c4-488e-a9c1-3ca52ea5a9e8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pUazujqh {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d5453469-c50d-41c0-a39b-a0d4d3add762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bdb0629d-0150-445c-b842-52a1c0ebbd41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5b925b2-8341-4f1f-99d0-4a27ce9efe1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pUazujqh" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372ff2f-79ab-45b3-8c37-963636fd2c84]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pUazujqh'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2aab1-d66a-4293-b97d-5e2b6c136665]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d5274-4122-40b5-aec3-af6b79611269]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf576db7-2e3a-4c45-b077-f4f0d5b27349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260]
Oct 20 13:08:53 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2c9c65-aa08-4f4b-b590-57ddd18d0ec1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[964aca06-5bc5-4ad0-b36b-3dcad7f1ef82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:53 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16a9d0-83b4-4dac-a68f-287dff3b10c2]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUazujqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updated VIF entry in instance network info cache for port 8e5d0654-5690-49ac-a149-0283de693b26. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating instance_info_cache with network_info: [{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96f58f59-d20b-4ca8-a89f-5c165fb44f51 req-ccd66a63-76a8-45b0-a4f9-cabcad90809c service nova] Releasing lock "refresh_cache-d275ea5d-2ee8-4474-be60-57675370409f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '23534386362373436', 'path': '/dev/sdg'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534386362373436', 'path': '/dev/sdg'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsutmynR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:08:54 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:54 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:08:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:08:54 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:08:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cca8d1-172e-414e-be01-35df4ac62c15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:08:55 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33c5119-bf55-465b-aa0d-ebc36d4ca2a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9] added
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0493586b-c927-4e54-bf12-b28b917bba84]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc31400-4c8c-4e97-811e-ae3f2235e990]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsutmynR {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsutmynR" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14549d-346f-458c-af7f-ddf8956a4f1c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsutmynR'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b394d005-7a87-4f1f-a485-79b0ed730f65]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82668d7-cd75-489f-b6ef-0789c6152c8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[199310da-ac4b-406b-af7c-274887035dd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260]
Oct 20 13:08:55 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260] successful.
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[13faf38e-9714-4904-a742-1aef9e54cb12]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2318fb-ae98-43de-8af6-e8108b6d4bb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:08:55 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:08:55 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a052755-cf2c-4d2a-acdd-195d8cda37dc]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsutmynR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:08:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:08:56 user nova-compute[74701]: INFO nova.compute.claims [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Claim successful on node user
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23963353735313535', 'path': '/dev/sdh'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963353735313535', 'path': '/dev/sdh'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.objects.instance [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lazy-loading 'pci_devices' on Instance uuid 71b23879-5dfd-44df-b6ca-6abad87aefa3 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:08:56 user nova-compute[74701]:   <uuid>71b23879-5dfd-44df-b6ca-6abad87aefa3</uuid>
Oct 20 13:08:56 user nova-compute[74701]:   <name>instance-0000000a</name>
Oct 20 13:08:56 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:08:56 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:08:56 user nova-compute[74701]:   <metadata>
Oct 20 13:08:56 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:08:56 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:name>tempest-device-tagging-server-793640575</nova:name>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:08:51</nova:creationTime>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:08:56 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:08:56 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:owner>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:user uuid="d5e1413023154e23bd8a99fa5ab17836">tempest-TaggedBootDevicesTest-18514064-project-member</nova:user>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:project uuid="313a39d5426941ec816042fe52a8e544">tempest-TaggedBootDevicesTest-18514064</nova:project>
Oct 20 13:08:56 user nova-compute[74701]:       </nova:owner>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:08:56 user nova-compute[74701]:       <nova:ports>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="e8b7060d-22e1-4259-81f0-e1be95abc54b">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="a1328795-0748-42ec-a6f4-4e87389cb271">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="5ee9a45a-c431-47d6-849d-2313a7b27afd">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="d14d71af-e9c3-4c50-93af-9dae07eb843d">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.200" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="7d5bd3cf-c4ee-463a-9c90-f51022ff5013">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="2c6ffd26-46fa-48e4-8a9e-c992870b08a7">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:         <nova:port uuid="0b35cd52-4089-47c0-9042-1a5edee5913f">
Oct 20 13:08:56 user nova-compute[74701]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 13:08:56 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:56 user nova-compute[74701]:       </nova:ports>
Oct 20 13:08:56 user nova-compute[74701]:     </nova:instance>
Oct 20 13:08:56 user nova-compute[74701]:   </metadata>
Oct 20 13:08:56 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:08:56 user nova-compute[74701]:     <system>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="serial">71b23879-5dfd-44df-b6ca-6abad87aefa3</entry>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="uuid">71b23879-5dfd-44df-b6ca-6abad87aefa3</entry>
Oct 20 13:08:56 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:08:56 user nova-compute[74701]:     </system>
Oct 20 13:08:56 user nova-compute[74701]:   </sysinfo>
Oct 20 13:08:56 user nova-compute[74701]:   <os>
Oct 20 13:08:56 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:08:56 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:08:56 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:08:56 user nova-compute[74701]:   </os>
Oct 20 13:08:56 user nova-compute[74701]:   <features>
Oct 20 13:08:56 user nova-compute[74701]:     <acpi/>
Oct 20 13:08:56 user nova-compute[74701]:     <apic/>
Oct 20 13:08:56 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:08:56 user nova-compute[74701]:   </features>
Oct 20 13:08:56 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:08:56 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:08:56 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:08:56 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:08:56 user nova-compute[74701]:   </clock>
Oct 20 13:08:56 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:08:56 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:08:56 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:08:56 user nova-compute[74701]:   </cpu>
Oct 20 13:08:56 user nova-compute[74701]:   <devices>
Oct 20 13:08:56 user nova-compute[74701]:     <disk type="file" device="cdrom">
Oct 20 13:08:56 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 13:08:56 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/disk.config"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="hda" bus="ide"/>
Oct 20 13:08:56 user nova-compute[74701]:     </disk>
Oct 20 13:08:56 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:08:56 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:56 user nova-compute[74701]:       <source dev="/dev/sdf"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <serial>cda19f5d-0905-4802-a806-545f25ab9380</serial>
Oct 20 13:08:56 user nova-compute[74701]:     </disk>
Oct 20 13:08:56 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:08:56 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:56 user nova-compute[74701]:       <source dev="/dev/sdg"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <serial>12fb63a6-b752-4981-9def-1ed105e6593c</serial>
Oct 20 13:08:56 user nova-compute[74701]:     </disk>
Oct 20 13:08:56 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:08:56 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:08:56 user nova-compute[74701]:       <source dev="/dev/sdh"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="vdc" bus="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <serial>7f86708c-5e83-496a-bd06-b2281e0d2ab9</serial>
Oct 20 13:08:56 user nova-compute[74701]:     </disk>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:62:a5:53"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tape8b7060d-22"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:57:e8:d8"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tapa1328795-07"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:94:05:15"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tap5ee9a45a-c4"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:2d:b6:34"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tapd14d71af-e9"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:a1:9a:a6"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tap7d5bd3cf-c4"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:aa:8d:20"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tap2c6ffd26-46"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:56 user nova-compute[74701]:       <mac address="fa:16:3e:88:e2:f6"/>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:56 user nova-compute[74701]:       <target dev="tap0b35cd52-40"/>
Oct 20 13:08:56 user nova-compute[74701]:     </interface>
Oct 20 13:08:56 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:08:56 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/console.log" append="off"/>
Oct 20 13:08:56 user nova-compute[74701]:     </serial>
Oct 20 13:08:56 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:08:56 user nova-compute[74701]:     <video>
Oct 20 13:08:56 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:56 user nova-compute[74701]:     </video>
Oct 20 13:08:56 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:08:56 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:08:56 user nova-compute[74701]:     </rng>
Oct 20 13:08:56 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:08:56 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:08:56 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:08:56 user nova-compute[74701]:     </memballoon>
Oct 20 13:08:56 user nova-compute[74701]:   </devices>
Oct 20 13:08:56 user nova-compute[74701]: </domain>
Oct 20 13:08:56 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc77770f-682c-5eaa-a54e-77e6154375ed', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b7060d-22, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b7060d-22, col_values=(('qos', UUID('7d33b156-68d4-4f4a-8a9f-fd6bd1da2c33')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b7060d-22, col_values=(('external_ids', {'iface-id': 'e8b7060d-22e1-4259-81f0-e1be95abc54b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a5:53', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22')
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0faaf959-3f50-5b60-a938-ee7be98e7a79', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1328795-07, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1328795-07, col_values=(('qos', UUID('28c0c406-7052-449e-87e6-9ffdeae777dd')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1328795-07, col_values=(('external_ids', {'iface-id': 'a1328795-0748-42ec-a6f4-4e87389cb271', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e8:d8', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07')
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9402342a-8279-5e40-95cb-25e557943a77', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ee9a45a-c4, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ee9a45a-c4, col_values=(('qos', UUID('9d252267-8607-499a-baf4-625e6f8b9528')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ee9a45a-c4, col_values=(('external_ids', {'iface-id': '5ee9a45a-c431-47d6-849d-2313a7b27afd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:05:15', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4')
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea6fb76c-7364-5d1d-b03c-e45a70227d0d', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd14d71af-e9, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd14d71af-e9, col_values=(('qos', UUID('c9407b1f-1b4a-49d9-801a-3c61bc38b29c')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd14d71af-e9, col_values=(('external_ids', {'iface-id': 'd14d71af-e9c3-4c50-93af-9dae07eb843d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:b6:34', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9')
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48227ea2-fc1b-5479-a99a-b68991a6ba6f', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d5bd3cf-c4, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d5bd3cf-c4, col_values=(('qos', UUID('c0ef77ec-6a25-4a07-8b2f-3df7a9ef58d6')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d5bd3cf-c4, col_values=(('external_ids', {'iface-id': '7d5bd3cf-c4ee-463a-9c90-f51022ff5013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:9a:a6', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4')
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ff64c61-a41f-5595-a1e2-b5742aaac0fb', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.782s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c6ffd26-46, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c6ffd26-46, col_values=(('qos', UUID('9f19fe70-1b34-48c4-95f4-b2c2357f03b5')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c6ffd26-46, col_values=(('external_ids', {'iface-id': '2c6ffd26-46fa-48e4-8a9e-c992870b08a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:8d:20', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:08:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46')
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e2a02ad-f7fc-5e16-ae39-2f788c0c562b', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b35cd52-40, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b35cd52-40, col_values=(('qos', UUID('eee29861-b716-4ae3-859c-4e0ece61bb49')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b35cd52-40, col_values=(('external_ids', {'iface-id': '0b35cd52-4089-47c0-9042-1a5edee5913f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:e2:f6', 'vm-uuid': '71b23879-5dfd-44df-b6ca-6abad87aefa3'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:08:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Creating image(s)
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "/opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:57 user nova-compute[74701]: INFO os_vif [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40')
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] No BDM found with device name hda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] No VIF found with MAC fa:16:3e:62:a5:53, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] No VIF found with MAC fa:16:3e:a1:9a:a6, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Using config drive
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.policy [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09e73f4fb1c410db0d365d04722a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea6d60f8e654cc2af2ec7085c001ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.222s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Creating config drive at /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/disk.config
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpubv_ldqu {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpubv_ldqu" returned: 0 in 0.085s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk 1073741824" returned: 0 in 0.050s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:08:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Successfully created port: 26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Cannot resize image /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Ensure instance console log exists: /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Successfully updated port: 26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquired lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-changed-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Refreshing instance network info cache due to event network-changed-26053974-4792-4e45-8439-aef9778cc5f3. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] Acquiring lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:08:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updating instance_info_cache with network_info: [{"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Releasing lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Instance network_info: |[{"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] Acquired lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Refreshing network info cache for port 26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Start _get_guest_xml network_info=[{"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:08:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947884722',display_name='tempest-AttachVolumeNegativeTest-server-1947884722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947884722',id=12,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPPWbJjDPb3MVGGJn023LmNmvlrUzAX6YIi/BWRL4bDc/CwedTV8Q3XWFgyqzs9JbJrZgfK46GkfFKGuKvXRb4SiFxedmwE1EF39Wq3QxwYVN03bMdzOGy2fqVXuXZdtw==',key_name='tempest-keypair-616765592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-9p0mhx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=304e7ddb-040e-4da7-8d52-1e183369827f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'pci_devices' on Instance uuid 304e7ddb-040e-4da7-8d52-1e183369827f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:08:59 user nova-compute[74701]:   <uuid>304e7ddb-040e-4da7-8d52-1e183369827f</uuid>
Oct 20 13:08:59 user nova-compute[74701]:   <name>instance-0000000c</name>
Oct 20 13:08:59 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:08:59 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:08:59 user nova-compute[74701]:   <metadata>
Oct 20 13:08:59 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:08:59 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1947884722</nova:name>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:08:59</nova:creationTime>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:08:59 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:08:59 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:owner>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:user uuid="a09e73f4fb1c410db0d365d04722a4fe">tempest-AttachVolumeNegativeTest-1431718944-project-member</nova:user>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:project uuid="3ea6d60f8e654cc2af2ec7085c001ea1">tempest-AttachVolumeNegativeTest-1431718944</nova:project>
Oct 20 13:08:59 user nova-compute[74701]:       </nova:owner>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:08:59 user nova-compute[74701]:       <nova:ports>
Oct 20 13:08:59 user nova-compute[74701]:         <nova:port uuid="26053974-4792-4e45-8439-aef9778cc5f3">
Oct 20 13:08:59 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:08:59 user nova-compute[74701]:         </nova:port>
Oct 20 13:08:59 user nova-compute[74701]:       </nova:ports>
Oct 20 13:08:59 user nova-compute[74701]:     </nova:instance>
Oct 20 13:08:59 user nova-compute[74701]:   </metadata>
Oct 20 13:08:59 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:08:59 user nova-compute[74701]:     <system>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="serial">304e7ddb-040e-4da7-8d52-1e183369827f</entry>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="uuid">304e7ddb-040e-4da7-8d52-1e183369827f</entry>
Oct 20 13:08:59 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:08:59 user nova-compute[74701]:     </system>
Oct 20 13:08:59 user nova-compute[74701]:   </sysinfo>
Oct 20 13:08:59 user nova-compute[74701]:   <os>
Oct 20 13:08:59 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:08:59 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:08:59 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:08:59 user nova-compute[74701]:   </os>
Oct 20 13:08:59 user nova-compute[74701]:   <features>
Oct 20 13:08:59 user nova-compute[74701]:     <acpi/>
Oct 20 13:08:59 user nova-compute[74701]:     <apic/>
Oct 20 13:08:59 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:08:59 user nova-compute[74701]:   </features>
Oct 20 13:08:59 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:08:59 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:08:59 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:08:59 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:08:59 user nova-compute[74701]:   </clock>
Oct 20 13:08:59 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:08:59 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:08:59 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:08:59 user nova-compute[74701]:   </cpu>
Oct 20 13:08:59 user nova-compute[74701]:   <devices>
Oct 20 13:08:59 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:08:59 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:08:59 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk"/>
Oct 20 13:08:59 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:08:59 user nova-compute[74701]:     </disk>
Oct 20 13:08:59 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:08:59 user nova-compute[74701]:       <mac address="fa:16:3e:05:76:67"/>
Oct 20 13:08:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:59 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:08:59 user nova-compute[74701]:       <target dev="tap26053974-47"/>
Oct 20 13:08:59 user nova-compute[74701]:     </interface>
Oct 20 13:08:59 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:08:59 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/console.log" append="off"/>
Oct 20 13:08:59 user nova-compute[74701]:     </serial>
Oct 20 13:08:59 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:08:59 user nova-compute[74701]:     <video>
Oct 20 13:08:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:08:59 user nova-compute[74701]:     </video>
Oct 20 13:08:59 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:08:59 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:08:59 user nova-compute[74701]:     </rng>
Oct 20 13:08:59 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:08:59 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:08:59 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:08:59 user nova-compute[74701]:     </memballoon>
Oct 20 13:08:59 user nova-compute[74701]:   </devices>
Oct 20 13:08:59 user nova-compute[74701]: </domain>
Oct 20 13:08:59 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947884722',display_name='tempest-AttachVolumeNegativeTest-server-1947884722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947884722',id=12,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPPWbJjDPb3MVGGJn023LmNmvlrUzAX6YIi/BWRL4bDc/CwedTV8Q3XWFgyqzs9JbJrZgfK46GkfFKGuKvXRb4SiFxedmwE1EF39Wq3QxwYVN03bMdzOGy2fqVXuXZdtw==',key_name='tempest-keypair-616765592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-9p0mhx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=304e7ddb-040e-4da7-8d52-1e183369827f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG os_vif [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b223a799-8e59-50ce-86c6-29077d9f6d6d', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26053974-47, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26053974-47, col_values=(('qos', UUID('56b56507-6409-4e02-8e4a-2a3c8531f758')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26053974-47, col_values=(('external_ids', {'iface-id': '26053974-4792-4e45-8439-aef9778cc5f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:76:67', 'vm-uuid': '304e7ddb-040e-4da7-8d52-1e183369827f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:08:59 user nova-compute[74701]: WARNING nova.compute.manager [req-09eeb7e8-1045-434f-ba24-f01f2fdeac44 req-9246b841-9a90-43aa-aa08-20534122fe26 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b for instance with vm_state building and task_state spawning.
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: INFO os_vif [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47')
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:05:76:67, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updated VIF entry in instance network info cache for port 26053974-4792-4e45-8439-aef9778cc5f3. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updating instance_info_cache with network_info: [{"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f90e9031-be99-4c52-9e78-0a65dbe9886e req-b4428497-837d-4859-9556-b33dd0f700f2 service nova] Releasing lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:08:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:00 user nova-compute[74701]: WARNING nova.compute.manager [req-0fc6ae4e-b6be-4863-9c77-dd1db1e59167 req-de24b659-e7e6-4c60-b0c5-728a5defc78e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 for instance with vm_state building and task_state spawning.
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:00 user nova-compute[74701]: WARNING nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd for instance with vm_state building and task_state spawning.
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:00 user nova-compute[74701]: WARNING nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd for instance with vm_state building and task_state spawning.
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:00 user nova-compute[74701]: WARNING nova.compute.manager [req-15424433-133b-4409-8068-d3ca8dec8294 req-e5b5cd11-2355-400f-a165-5602f2b32e21 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d for instance with vm_state building and task_state spawning.
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:01 user nova-compute[74701]: WARNING nova.compute.manager [req-a751d78a-45ae-458c-8a8c-18891aa49195 req-57e4a983-a84e-4995-9822-20a46227d47f service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b for instance with vm_state building and task_state spawning.
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-349f3698-7f35-4124-8fc4-fb5b0060bebd req-2961ce44-a524-4645-9c74-14142b549a3d service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:02 user nova-compute[74701]: WARNING nova.compute.manager [req-34539140-c16d-45e2-9ec6-b3fce716d3c6 req-a858d265-81a9-459b-84a9-4e84c8a11ab2 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 for instance with vm_state building and task_state spawning.
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] No waiting events found dispatching network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:03 user nova-compute[74701]: WARNING nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received unexpected event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 for instance with vm_state building and task_state spawning.
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] No waiting events found dispatching network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:03 user nova-compute[74701]: WARNING nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received unexpected event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 for instance with vm_state building and task_state spawning.
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:03 user nova-compute[74701]: WARNING nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f for instance with vm_state building and task_state spawning.
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:03 user nova-compute[74701]: WARNING nova.compute.manager [req-a063f045-5853-4437-aa63-bec09e8c880f req-3002b469-0435-482d-9e6d-20d51d1b809e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f for instance with vm_state building and task_state spawning.
Oct 20 13:09:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance spawned successfully.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Instance spawned successfully.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Took 8.04 seconds to spawn the instance on the hypervisor.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Took 13.58 seconds to spawn the instance on the hypervisor.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.compute.manager [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Took 9.24 seconds to build instance.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6f4bbca9-f4a9-4237-9704-8ce7e99b5714 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.336s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:05 user nova-compute[74701]: INFO nova.compute.manager [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Took 90.79 seconds to build instance.
Oct 20 13:09:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-205e51bb-c0d2-45ed-9f29-4a2fbf3f8ac4 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.889s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcvSUlDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:10 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:10 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:10 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68110281-9d8c-4457-8ed6-152cd27ed9c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:09:10 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30e556-11f8-4185-abcc-8be9f400f205]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034] added
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd3733-3f7d-48a6-acd8-095a9f9b1830]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa932f-86a8-4d2c-aa12-0c46b22189ea]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wcvSUlDC {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wcvSUlDC" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45272b73-f6ae-4938-93f3-351e1ac28072]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wcvSUlDC'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: INFO nova.compute.manager [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Detaching volume 93150aa6-6b19-403f-af61-25ef72c8be68
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba30e29-bc1b-4ea6-8723-d5434c4500f5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cd1e5-8478-4672-b98a-d496730225c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef45577-4a5b-4da4-98fe-e040b6689cf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260]
Oct 20 13:09:10 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432d9f2-13e2-48a7-a17c-b41cede92860]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd075a-eb15-4ee3-b6d1-8469c6beb293]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7464aef-7147-4462-b588-38d83fa17660]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:09:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcvSUlDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.compute.manager [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Detaching volume 5bc5a489-0923-441b-8f96-e76c10c72414
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.virt.block_device [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Attempting to driver detach volume 93150aa6-6b19-403f-af61-25ef72c8be68 from mountpoint /dev/vdb
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Attempting to detach device vdb from instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:11 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:11 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:09:11 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:11 user nova-compute[74701]:   <serial>93150aa6-6b19-403f-af61-25ef72c8be68</serial>
Oct 20 13:09:11 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:09:11 user nova-compute[74701]: </disk>
Oct 20 13:09:11 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully detached device vdb from instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 from the persistent domain config.
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:11 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:11 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:09:11 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:11 user nova-compute[74701]:   <serial>93150aa6-6b19-403f-af61-25ef72c8be68</serial>
Oct 20 13:09:11 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:09:11 user nova-compute[74701]: </disk>
Oct 20 13:09:11 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.virt.block_device [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Attempting to driver detach volume 5bc5a489-0923-441b-8f96-e76c10c72414 from mountpoint /dev/vdb
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Attempting to detach device vdb from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:11 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:11 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:09:11 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:11 user nova-compute[74701]:   <serial>5bc5a489-0923-441b-8f96-e76c10c72414</serial>
Oct 20 13:09:11 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:09:11 user nova-compute[74701]: </disk>
Oct 20 13:09:11 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully detached device vdb from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the persistent domain config.
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:11 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:11 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:09:11 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:11 user nova-compute[74701]:   <serial>5bc5a489-0923-441b-8f96-e76c10c72414</serial>
Oct 20 13:09:11 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:09:11 user nova-compute[74701]: </disk>
Oct 20 13:09:11 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23731373736656532', 'path': '/dev/sdi'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731373736656532', 'path': '/dev/sdi'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lazy-loading 'flavor' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:11 user nova-compute[74701]: INFO nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Rebuilding instance
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:09:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 13:09:11 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:11 user nova-compute[74701]:   <source dev="/dev/sdi"/>
Oct 20 13:09:11 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:11 user nova-compute[74701]:   <serial>2a8d807a-1a26-4c85-b1cf-9a8549f79034</serial>
Oct 20 13:09:11 user nova-compute[74701]: </disk>
Oct 20 13:09:11 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:12 user nova-compute[74701]: WARNING nova.compute.manager [req-1e651933-f937-48be-9efc-3c42e3d035b3 req-efbdc1e1-f3b8-463b-a737-4f6eb50165b5 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state rebuilding.
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:09:12 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Creating image(s)
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Ensure instance console log exists: /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Start _get_guest_xml network_info=[{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqzRlgKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f', 'attached_at': '', 'detached_at': '', 'volume_id': '572c85ea-c3b3-47dd-b54f-daf5f12c3668', 'serial': '572c85ea-c3b3-47dd-b54f-daf5f12c3668'}, 'attachment_id': '562ce7a8-b582-476b-9eb6-aecf446c8e37', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWEuaGHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aed2534f-14af-4e54-8235-42393831134b', 'serial': 'aed2534f-14af-4e54-8235-42393831134b'}, 'attachment_id': 'ef1caa30-af12-4d51-8319-331fc0425325', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdyRDzCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f', 'attached_at': '', 'detached_at': '', 'volume_id': '1f39f17b-884a-4717-acee-b137ca974d86', 'serial': '1f39f17b-884a-4717-acee-b137ca974d86'}, 'attachment_id': '339cf243-a40f-4944-ae95-6e54aa35d49a', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:09:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:09:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqzRlgKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:12 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cf723-258d-48d9-b198-8fdedcfe4a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:09:12 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc102c-c4ba-4089-adf1-6408754253c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668] added
Oct 20 13:09:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442c615-daec-4118-a9a0-d848909b0ea3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c70069b-ca59-496d-a000-fd648f161cb6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqzRlgKd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] No VIF found with MAC fa:16:3e:31:f7:63, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqzRlgKd" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a6675-761a-432b-b2f7-97ccfd55e71b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqzRlgKd'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[47586282-4349-486a-a2ed-11780484b765]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e39ecb3-b22a-41f5-b562-5d8605cfeb60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d30f1de-3a30-450c-8dfe-3a9440d99c13 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.184s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d164722-2189-400e-8c45-b8d011775664]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260]
Oct 20 13:09:13 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ab6033-98b6-4ddd-a7b2-054fa154b1c6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance destroyed successfully.
Oct 20 13:09:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance destroyed successfully.
Oct 20 13:09:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1074964372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:07:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e5d0654-56, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8ff1c28-7980-4e6d-a5a9-9f3b6f54406c) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9e72e-4bed-4443-badf-a58de44407a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:13 user nova-compute[74701]: INFO os_vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56')
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ece870-8d4b-4d02-89ce-10b9bc7fa985]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:09:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqzRlgKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23230643762343833', 'path': '/dev/sdj'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230643762343833', 'path': '/dev/sdj'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.038s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6023670f-46b5-4bb8-9466-3e75138bfe96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:14 user nova-compute[74701]: No targets found.
Oct 20 13:09:14 user nova-compute[74701]: iSNS:
Oct 20 13:09:14 user nova-compute[74701]: No targets found.
Oct 20 13:09:14 user nova-compute[74701]: STATIC:
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:14 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:14 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:14 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:14 user nova-compute[74701]: No targets found.
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:14 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:14 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWEuaGHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:14 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[098510cb-4df4-4289-a673-03eb8f7ee917]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5996aef0-cb68-4a54-ace9-bd7db4a77c9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8700134040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6a699-1b3b-4b8c-b8c4-b1a99fc032ba]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8467b91-bea7-496c-8577-f85125bc12e9]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780e245-2b91-44f6-a2c7-49cd8e726bbd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1211b-dec0-4e8e-ba14-6154512bbbf6]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0fee3d-48f1-45a5-b3a0-e968792155f3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] volume_snapshot_create: create_info: {'snapshot_id': '5fb45adb-84f6-4378-9b3c-41b470c8ab15', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74701) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] snap xml: <domainsnapshot>
Oct 20 13:09:14 user nova-compute[74701]:   <disks>
Oct 20 13:09:14 user nova-compute[74701]:     <disk name="/dev/sdi" snapshot="external" type="file">
Oct 20 13:09:14 user nova-compute[74701]:       <source file="/dev/new_file"/>
Oct 20 13:09:14 user nova-compute[74701]:     </disk>
Oct 20 13:09:14 user nova-compute[74701]:     <disk name="vda" snapshot="no"/>
Oct 20 13:09:14 user nova-compute[74701]:   </disks>
Oct 20 13:09:14 user nova-compute[74701]: </domainsnapshot>
Oct 20 13:09:14 user nova-compute[74701]:  {{(pid=74701) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] Lazy-loading 'system_metadata' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[387eb032-f229-4b6f-a1c6-cd03a8ab8d98]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]
Oct 20 13:09:14 user nova-compute[74701]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b8bf9f65-dc16-4ad9-bd4e-ad808838c8e6 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] volume_snapshot_delete: delete_info: {'volume_id': '2a8d807a-1a26-4c85-b1cf-9a8549f79034'} {{(pid=74701) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [None req-b8bf9f65-dc16-4ad9-bd4e-ad808838c8e6 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     if delete_info['type'] != 'qcow2':
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] KeyError: 'type'
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     rv = execute(f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     six.reraise(c, e, tb)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     raise value
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     rv = meth(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     self._volume_snapshot_create(context, instance, guest,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     rv = execute(f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     six.reraise(c, e, tb)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     raise value
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     rv = meth(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] 
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c0bf8-8258-4665-bd1d-949d100365e9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== disconnect_volume: return (1442ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deleting instance files /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f_del
Oct 20 13:09:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deletion of /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f_del complete
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.359s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:14 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:14 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:14 user nova-compute[74701]: WARNING nova.compute.manager [req-89517f21-d36b-4088-b789-72ef267cab2e req-bd999f8b-5a78-4842-977d-9346fb81b028 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state rebuilding.
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af6bbf-466a-4a0c-ae41-3bd5d7f2c497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:09:14 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [None req-b8bf9f65-dc16-4ad9-bd4e-ad808838c8e6 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a135ff74-1e2a-4ce9-8a10-14c4c7c7931e)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd84ac-874d-4c99-81b8-8f20db7329fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5fb45adb-84f6-4378-9b3c-41b470c8ab15 could not be found.
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5fb45adb-84f6-4378-9b3c-41b470c8ab15 could not be found. (HTTP 404) (Request-ID: req-3ee4466a-379c-40c8-adb3-cbb31000a68f)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5fb45adb-84f6-4378-9b3c-41b470c8ab15 could not be found.
Oct 20 13:09:14 user nova-compute[74701]: ERROR nova.virt.libvirt.driver 
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b] added
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server [None req-b8bf9f65-dc16-4ad9-bd4e-ad808838c8e6 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] Exception during message handling: KeyError: 'type'
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server 
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server [None req-54128d6c-cc75-43a0-a394-19260f9625b8 tempest-VolumesAssistedSnapshotsTest-1749134676 tempest-VolumesAssistedSnapshotsTest-1749134676-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 13:09:14 user nova-compute[74701]: ERROR oslo_messaging.rpc.server 
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc2628-9330-4547-b5fd-7a6b4538ffe1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c588b63-2668-4e17-8734-96021d5b29db]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWEuaGHD {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWEuaGHD" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d9ddb1-2605-4caf-9275-bdac617ec131]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gWEuaGHD'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[73915afb-a708-483c-9867-590b5d808168]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc59f16-050f-427d-9afb-3997d4091d63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d275ea5d-2ee8-4474-be60-57675370409f could not be found.
Oct 20 13:09:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:14 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae08a2-8b43-4484-974b-4a931af65f8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260]
Oct 20 13:09:14 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb162e4-0d7f-483e-87ff-9e8222829f80]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[218445fc-1dc8-43ce-ad05-f018c1e07a85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:09:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:09:15 user nova-compute[74701]: INFO nova.compute.manager [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Detaching volume 2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4530d6-55ef-4ceb-aae1-e01265d9801c]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWEuaGHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:09:15 user nova-compute[74701]: INFO nova.virt.block_device [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Attempting to driver detach volume 2a8d807a-1a26-4c85-b1cf-9a8549f79034 from mountpoint /dev/vdb
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Attempting to detach device vdb from instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:15 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:15 user nova-compute[74701]:   <source dev="/dev/sdi"/>
Oct 20 13:09:15 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:15 user nova-compute[74701]:   <serial>2a8d807a-1a26-4c85-b1cf-9a8549f79034</serial>
Oct 20 13:09:15 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:09:15 user nova-compute[74701]: </disk>
Oct 20 13:09:15 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:15 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Successfully detached device vdb from instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c from the persistent domain config.
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:15 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:15 user nova-compute[74701]:   <source dev="/dev/sdi"/>
Oct 20 13:09:15 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:09:15 user nova-compute[74701]:   <serial>2a8d807a-1a26-4c85-b1cf-9a8549f79034</serial>
Oct 20 13:09:15 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:09:15 user nova-compute[74701]: </disk>
Oct 20 13:09:15 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhSjBHiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:15 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== connect_volume: return (1845ms) {'type': 'block', 'scsi_wwn': '26133333030396632', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133333030396632', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.218s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdyRDzCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:16 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1c69a-d15a-4c58-896a-4c6dc4c55d32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:16 user nova-compute[74701]: No targets found.
Oct 20 13:09:16 user nova-compute[74701]: iSNS:
Oct 20 13:09:16 user nova-compute[74701]: No targets found.
Oct 20 13:09:16 user nova-compute[74701]: STATIC:
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:16 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:16 user nova-compute[74701]: No targets found.
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:16 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:16 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086acf7-dcac-44e0-b313-7d96a5652e58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4acd5-8180-4dd8-876a-b7d23c0d7bc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02f4790>, {}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Disconnecting from: [] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== disconnect_volume: return (1311ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.437s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:16 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:16 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[191467d1-56a6-4cc0-9297-b715a088f45a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:09:16 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d7079-8688-42f0-886b-f7087403cbaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd] added
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7115188-b57a-4355-97ca-15d5a546bf7b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff8fce7-6fda-4b39-88bd-22436ff0dd91]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhSjBHiu {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhSjBHiu" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31e52b-194c-4834-868d-e276c3dbf08d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhSjBHiu'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d51e22-2d5b-4527-a4dc-3bc21141bc86]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415f5fd-85e6-4a44-b9d5-aadc0dffd5db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5e914-245f-4475-a00f-00a9befeadef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260]
Oct 20 13:09:16 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd94db-6f0e-4ffc-aa96-30f69117d882]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be2d75-f778-4d66-b3db-117a11621e97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9cbbc6-a9aa-4379-a889-a4ce720432a0]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:09:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhSjBHiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Preparing to wait for external event volume-reimaged-8130bccf-b499-4013-a02e-294619154a38 {{(pid=74701) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] <== connect_volume: return (1846ms) {'type': 'block', 'scsi_wwn': '26135363361633438', 'path': '/dev/sdk'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135363361633438', 'path': '/dev/sdk'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.480s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:17 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:17 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG nova.objects.instance [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lazy-loading 'flavor' on Instance uuid d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01408336-947f-4e3a-9eec-93cf8df0554a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:09:17 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:09:17 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:17 user nova-compute[74701]:   <source dev="/dev/sdk"/>
Oct 20 13:09:17 user nova-compute[74701]:   <target dev="sdc" bus="scsi"/>
Oct 20 13:09:17 user nova-compute[74701]:   <serial>8af1fc40-0463-44e6-a3c7-745fa05c17fd</serial>
Oct 20 13:09:17 user nova-compute[74701]:   <address type="drive" controller="0" unit="2"/>
Oct 20 13:09:17 user nova-compute[74701]: </disk>
Oct 20 13:09:17 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[25233e34-9440-4318-928f-84e4528ec9f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86] added
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e8552-7fec-4fd6-b93a-9943f5136b13]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb222b8a-929c-4244-a2cb-04bfaa5d6180]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdyRDzCf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdyRDzCf" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d84ae0-fa19-489a-8c93-989df11b6228]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jdyRDzCf'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c56bed2-c706-45b3-b687-a6ce069e9b3f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68a06c-2632-4c83-be7d-d15f8b6ec120]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[38538762-c4d6-4c83-8982-b2bcec4803be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260]
Oct 20 13:09:17 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dec922-6d58-4954-b378-cd739e127a4c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b5d3c8-0d91-4a04-8101-d8346c97db49]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1560e6c-c169-4888-af7f-89c46f069026]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:09:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdyRDzCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No BDM found with device name sda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] No VIF found with MAC fa:16:3e:91:57:3e, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e4efcb55-a4d8-4180-9fc5-ff919fd184fe tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.103s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== connect_volume: return (2878ms) {'type': 'block', 'scsi_wwn': '26434613865336134', 'path': '/dev/sdl'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434613865336134', 'path': '/dev/sdl'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.objects.instance [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lazy-loading 'pci_devices' on Instance uuid f5b925b2-8341-4f1f-99d0-4a27ce9efe1f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:09:19 user nova-compute[74701]:   <uuid>f5b925b2-8341-4f1f-99d0-4a27ce9efe1f</uuid>
Oct 20 13:09:19 user nova-compute[74701]:   <name>instance-0000000b</name>
Oct 20 13:09:19 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:09:19 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:09:19 user nova-compute[74701]:   <metadata>
Oct 20 13:09:19 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:19 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:name>tempest-device-tagging-server-630007420</nova:name>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:09:12</nova:creationTime>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:09:19 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:19 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:owner>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:user uuid="81217338ece64953b1869c69ba9fe8c1">tempest-TaggedBootDevicesTest_v242-1811732526-project-member</nova:user>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:project uuid="d210ff985ac9417ebd810027ce595cff">tempest-TaggedBootDevicesTest_v242-1811732526</nova:project>
Oct 20 13:09:19 user nova-compute[74701]:       </nova:owner>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:19 user nova-compute[74701]:       <nova:ports>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="66432bbd-7941-4c6a-ab87-da0374b16c4c">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="8660bbaa-5d3d-497e-8f78-b82dfe70c6bd">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="d54532ea-fdfc-47b2-9125-f80a90a56046">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="ea1166c4-57e2-4f09-acf1-4e026c0a847f">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="b503c659-a651-41a0-bed4-592c91f6bea9">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="ad025839-f8cd-41da-9ac8-4014d6e6e408">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:         <nova:port uuid="a1234d8f-4aef-4b5d-9d45-df89de104b96">
Oct 20 13:09:19 user nova-compute[74701]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 13:09:19 user nova-compute[74701]:         </nova:port>
Oct 20 13:09:19 user nova-compute[74701]:       </nova:ports>
Oct 20 13:09:19 user nova-compute[74701]:     </nova:instance>
Oct 20 13:09:19 user nova-compute[74701]:   </metadata>
Oct 20 13:09:19 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:09:19 user nova-compute[74701]:     <system>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="serial">f5b925b2-8341-4f1f-99d0-4a27ce9efe1f</entry>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="uuid">f5b925b2-8341-4f1f-99d0-4a27ce9efe1f</entry>
Oct 20 13:09:19 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:09:19 user nova-compute[74701]:     </system>
Oct 20 13:09:19 user nova-compute[74701]:   </sysinfo>
Oct 20 13:09:19 user nova-compute[74701]:   <os>
Oct 20 13:09:19 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:09:19 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:09:19 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:09:19 user nova-compute[74701]:   </os>
Oct 20 13:09:19 user nova-compute[74701]:   <features>
Oct 20 13:09:19 user nova-compute[74701]:     <acpi/>
Oct 20 13:09:19 user nova-compute[74701]:     <apic/>
Oct 20 13:09:19 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:09:19 user nova-compute[74701]:   </features>
Oct 20 13:09:19 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:09:19 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:09:19 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:09:19 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:09:19 user nova-compute[74701]:   </clock>
Oct 20 13:09:19 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:09:19 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:09:19 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:09:19 user nova-compute[74701]:   </cpu>
Oct 20 13:09:19 user nova-compute[74701]:   <devices>
Oct 20 13:09:19 user nova-compute[74701]:     <disk type="file" device="cdrom">
Oct 20 13:09:19 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 13:09:19 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/disk.config"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="hda" bus="ide"/>
Oct 20 13:09:19 user nova-compute[74701]:     </disk>
Oct 20 13:09:19 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:09:19 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:19 user nova-compute[74701]:       <source dev="/dev/sdj"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <serial>572c85ea-c3b3-47dd-b54f-daf5f12c3668</serial>
Oct 20 13:09:19 user nova-compute[74701]:     </disk>
Oct 20 13:09:19 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:09:19 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:19 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <serial>aed2534f-14af-4e54-8235-42393831134b</serial>
Oct 20 13:09:19 user nova-compute[74701]:     </disk>
Oct 20 13:09:19 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:09:19 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:19 user nova-compute[74701]:       <source dev="/dev/sdl"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="vdc" bus="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <serial>1f39f17b-884a-4717-acee-b137ca974d86</serial>
Oct 20 13:09:19 user nova-compute[74701]:     </disk>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:59:03:3b"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tap66432bbd-79"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:7b:55:4c"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tap8660bbaa-5d"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:27:bc:91"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tapd54532ea-fd"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:64:43:23"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tapea1166c4-57"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:e1:46:7c"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tapb503c659-a6"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:d5:32:2d"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tapad025839-f8"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:09:19 user nova-compute[74701]:       <mac address="fa:16:3e:22:7d:48"/>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:09:19 user nova-compute[74701]:       <target dev="tapa1234d8f-4a"/>
Oct 20 13:09:19 user nova-compute[74701]:     </interface>
Oct 20 13:09:19 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:09:19 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/console.log" append="off"/>
Oct 20 13:09:19 user nova-compute[74701]:     </serial>
Oct 20 13:09:19 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:09:19 user nova-compute[74701]:     <video>
Oct 20 13:09:19 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:09:19 user nova-compute[74701]:     </video>
Oct 20 13:09:19 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:09:19 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:09:19 user nova-compute[74701]:     </rng>
Oct 20 13:09:19 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:09:19 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:09:19 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:09:19 user nova-compute[74701]:     </memballoon>
Oct 20 13:09:19 user nova-compute[74701]:   </devices>
Oct 20 13:09:19 user nova-compute[74701]: </domain>
Oct 20 13:09:19 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8dc85f8-606d-5bd4-ab2d-600f8c7d11d5', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66432bbd-79, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66432bbd-79, col_values=(('qos', UUID('b5a46384-abd8-486a-a093-18688e16e7d1')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66432bbd-79, col_values=(('external_ids', {'iface-id': '66432bbd-7941-4c6a-ab87-da0374b16c4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:03:3b', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a28a062-0d17-5b50-b8c1-2e0e9483c30a', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8660bbaa-5d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8660bbaa-5d, col_values=(('qos', UUID('64cab667-eeff-406e-a003-f09933d18f4e')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8660bbaa-5d, col_values=(('external_ids', {'iface-id': '8660bbaa-5d3d-497e-8f78-b82dfe70c6bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:55:4c', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b4adf4c-318b-5fce-bc43-7604f03fd42c', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd54532ea-fd, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd54532ea-fd, col_values=(('qos', UUID('b5bdea41-c7c5-4f95-b5d6-a6e752abc083')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd54532ea-fd, col_values=(('external_ids', {'iface-id': 'd54532ea-fdfc-47b2-9125-f80a90a56046', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:bc:91', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dda0ed3-fc41-56c4-8a33-a44fe676068d', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1166c4-57, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea1166c4-57, col_values=(('qos', UUID('80e6ab45-c01f-43f2-a229-cb9893c075d0')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea1166c4-57, col_values=(('external_ids', {'iface-id': 'ea1166c4-57e2-4f09-acf1-4e026c0a847f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:43:23', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f6f5454-f442-5f14-aed1-94ee7eff2b5f', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb503c659-a6, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb503c659-a6, col_values=(('qos', UUID('0d07a022-4e4e-4f75-b227-691cb3111688')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb503c659-a6, col_values=(('external_ids', {'iface-id': 'b503c659-a651-41a0-bed4-592c91f6bea9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:46:7c', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7f89047-f7f5-5ecd-bf84-0c5fff29fb67', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad025839-f8, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad025839-f8, col_values=(('qos', UUID('ce9bd9bc-b4ff-460b-91fa-8320fa70249b')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad025839-f8, col_values=(('external_ids', {'iface-id': 'ad025839-f8cd-41da-9ac8-4014d6e6e408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:32:2d', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8')
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4683025d-c3ce-59cf-8873-67b5a2668b0b', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1234d8f-4a, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1234d8f-4a, col_values=(('qos', UUID('2259c6ba-7564-44bc-9156-5c5532a518a1')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1234d8f-4a, col_values=(('external_ids', {'iface-id': 'a1234d8f-4aef-4b5d-9d45-df89de104b96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:7d:48', 'vm-uuid': 'f5b925b2-8341-4f1f-99d0-4a27ce9efe1f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:19 user nova-compute[74701]: INFO nova.compute.manager [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Detaching volume 8af1fc40-0463-44e6-a3c7-745fa05c17fd
Oct 20 13:09:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:19 user nova-compute[74701]: INFO os_vif [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a')
Oct 20 13:09:19 user nova-compute[74701]: INFO nova.virt.block_device [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Attempting to driver detach volume 8af1fc40-0463-44e6-a3c7-745fa05c17fd from mountpoint /dev/sdc
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Attempting to detach device sdc from instance d5453469-c50d-41c0-a39b-a0d4d3add762 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:19 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:19 user nova-compute[74701]:   <source dev="/dev/sdk"/>
Oct 20 13:09:19 user nova-compute[74701]:   <target dev="sdc" bus="scsi"/>
Oct 20 13:09:19 user nova-compute[74701]:   <serial>8af1fc40-0463-44e6-a3c7-745fa05c17fd</serial>
Oct 20 13:09:19 user nova-compute[74701]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 13:09:19 user nova-compute[74701]: </disk>
Oct 20 13:09:19 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Successfully detached device sdc from instance d5453469-c50d-41c0-a39b-a0d4d3add762 from the persistent domain config.
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d5453469-c50d-41c0-a39b-a0d4d3add762 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:09:19 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:09:19 user nova-compute[74701]:   <source dev="/dev/sdk"/>
Oct 20 13:09:19 user nova-compute[74701]:   <target dev="sdc" bus="scsi"/>
Oct 20 13:09:19 user nova-compute[74701]:   <serial>8af1fc40-0463-44e6-a3c7-745fa05c17fd</serial>
Oct 20 13:09:19 user nova-compute[74701]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 13:09:19 user nova-compute[74701]: </disk>
Oct 20 13:09:19 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] No BDM found with device name hda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] No VIF found with MAC fa:16:3e:59:03:3b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:09:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] No VIF found with MAC fa:16:3e:e1:46:7c, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:09:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Using config drive
Oct 20 13:09:20 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Creating config drive at /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/disk.config
Oct 20 13:09:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8_ke0f54 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8_ke0f54" returned: 0 in 0.061s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:09:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:22 user nova-compute[74701]: WARNING nova.compute.manager [req-be809b1f-94a8-445e-aaa2-1dc9550fa274 req-9e1baad8-2ce9-4f04-ba10-4511d5bd7ba0 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c for instance with vm_state building and task_state spawning.
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:23 user nova-compute[74701]: WARNING nova.compute.manager [req-e69a934b-8b94-4a84-8e6b-56c6aab5fc23 req-6a1f46d8-d665-462a-ad17-813c2c565d39 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 for instance with vm_state building and task_state spawning.
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-ff5a5565-949d-4b63-aca4-deaf479e612b req-44149235-edfd-40fd-9e17-a1bf29469afe service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:24 user nova-compute[74701]: WARNING nova.compute.manager [req-b643829d-ec0f-4977-abc1-97f4c379fedc req-be7dfde3-1470-4f01-a76d-8df6bfd4b224 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 for instance with vm_state building and task_state spawning.
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:25 user nova-compute[74701]: WARNING nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 for instance with vm_state building and task_state spawning.
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:25 user nova-compute[74701]: WARNING nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 for instance with vm_state building and task_state spawning.
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:25 user nova-compute[74701]: WARNING nova.compute.manager [req-3419036c-9bac-4b84-a397-30ed9aaeda8c req-12d36c67-a061-475a-99f6-6c162f9e7ce6 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 for instance with vm_state building and task_state spawning.
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:26 user nova-compute[74701]: WARNING nova.compute.manager [req-6ab175ae-dc62-4c8e-853c-e5217bd123c8 req-caee4f3c-3aba-488e-aba5-fdd125a5692b service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 for instance with vm_state building and task_state spawning.
Oct 20 13:09:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:26 user nova-compute[74701]: WARNING nova.compute.manager [req-db1ce3a5-021a-468e-8bef-4d65e0b2f231 req-4212f4b6-b9fe-46c6-a1e1-1896633aaad3 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 for instance with vm_state building and task_state spawning.
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:09:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance spawned successfully.
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:09:27 user nova-compute[74701]: INFO nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Took 14.72 seconds to spawn the instance on the hypervisor.
Oct 20 13:09:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:09:27 user nova-compute[74701]: INFO nova.compute.manager [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Took 98.20 seconds to build instance.
Oct 20 13:09:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-990ad752-e685-45d7-88dc-acf060cea06a tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 98.338s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:31 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 is timed out.
Oct 20 13:09:31 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully detached device vdb from instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 from the live domain config.
Oct 20 13:09:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKwnzNkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:31 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ce7f6-ac1f-4d6e-998b-20bb687333df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:31 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:31 user nova-compute[74701]: No targets found.
Oct 20 13:09:31 user nova-compute[74701]: iSNS:
Oct 20 13:09:31 user nova-compute[74701]: No targets found.
Oct 20 13:09:31 user nova-compute[74701]: STATIC:
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:31 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:31 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:31 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:31 user nova-compute[74701]: No targets found.
Oct 20 13:09:31 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:32 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:32 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7affed0b-388e-458f-8813-c934dc8ab47e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e75cd2-e530-4697-a017-7a4f67a1cdec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0263520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea2d594-f6e6-4275-8ca2-ea9813a0c405]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6759d2d-8151-4ddc-a4b9-145c305d0311]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f77a4-6d28-47ac-848c-576397872bb6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d45581-42b7-485f-b839-320a59d7be57]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274a992-c7a4-4de0-adb2-09371cbfd1cf]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b08587-274a-4bce-b6c6-6f8328ee700a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260]
Oct 20 13:09:32 user nova-compute[74701]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93150aa6-6b19-403f-af61-25ef72c8be68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b843649-ea05-4485-98d8-ea154ce69f06]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] <== disconnect_volume: return (404ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 is timed out.
Oct 20 13:09:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully detached device vdb from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the live domain config.
Oct 20 13:09:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJzMCPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7dc84-531b-4ece-8fed-b5e2397e2fbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:33 user nova-compute[74701]: No targets found.
Oct 20 13:09:33 user nova-compute[74701]: iSNS:
Oct 20 13:09:33 user nova-compute[74701]: No targets found.
Oct 20 13:09:33 user nova-compute[74701]: STATIC:
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:33 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:33 user nova-compute[74701]: No targets found.
Oct 20 13:09:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:33 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:33 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2a863c-5cd9-4adc-a334-6372453438fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a17a67-2135-4171-b445-b9a12d92a4dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8705229750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414'): ({'sde'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Removing single pathed devices sde {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f55c41-49f4-4625-94eb-b7161f8ba02c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c986f-7540-446b-b2ed-299064b747eb]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Flushing IO for device /dev/sde {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41dafb-827a-4efe-bca5-e890d4b376a6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e6564c-6d71-4694-a23d-ae75bca8ac05]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fcffdb-edc6-4877-88d9-cef26b4d6a84]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e49fa74-db64-4aa4-8f03-f9b9d6277383]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260]
Oct 20 13:09:33 user nova-compute[74701]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc5a489-0923-441b-8f96-e76c10c72414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[13416874-0602-4ecc-9a00-049a9fe60323]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] <== disconnect_volume: return (428ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bb2a4ed5-4aba-4cad-b0fc-122fd57fb94f tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.485s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:35 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c is timed out.
Oct 20 13:09:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Successfully detached device vdb from instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c from the live domain config.
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wcvSUlDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:35 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eeb628-f2fd-4615-9908-47fc6b7b5f40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:35 user nova-compute[74701]: No targets found.
Oct 20 13:09:35 user nova-compute[74701]: iSNS:
Oct 20 13:09:35 user nova-compute[74701]: No targets found.
Oct 20 13:09:35 user nova-compute[74701]: STATIC:
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:35 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:35 user nova-compute[74701]: No targets found.
Oct 20 13:09:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:35 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:35 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e710f-3d1c-445e-9ea3-3cc111d6fe13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Attempting to detach device tap9a30e219-d6 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] detach device xml: <interface type="ethernet">
Oct 20 13:09:35 user nova-compute[74701]:   <mac address="fa:16:3e:34:da:4e"/>
Oct 20 13:09:35 user nova-compute[74701]:   <model type="virtio"/>
Oct 20 13:09:35 user nova-compute[74701]:   <mtu size="1442"/>
Oct 20 13:09:35 user nova-compute[74701]:   <target dev="tap9a30e219-d6"/>
Oct 20 13:09:35 user nova-compute[74701]: </interface>
Oct 20 13:09:35 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 13:09:35 user nova-compute[74701]:   <name>instance-00000007</name>
Oct 20 13:09:35 user nova-compute[74701]:   <uuid>bdb0629d-0150-445c-b842-52a1c0ebbd41</uuid>
Oct 20 13:09:35 user nova-compute[74701]:   <metadata>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:35 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:08:25</nova:creationTime>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:35 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:35 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:35 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:35 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:35 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:35 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:35 user nova-compute[74701]:     <nova:port uuid="9a30e219-d69f-40ef-8dd7-452ad5cc0e5c">
Oct 20 13:09:35 user nova-compute[74701]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Oct 20 13:09:35 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:35 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:35 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:35 user nova-compute[74701]:   </metadata>
Oct 20 13:09:35 user nova-compute[74701]:   <memory unit='KiB'>524288</memory>
Oct 20 13:09:35 user nova-compute[74701]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 13:09:35 user nova-compute[74701]:   <vcpu placement='static'>1</vcpu>
Oct 20 13:09:35 user nova-compute[74701]:   <resource>
Oct 20 13:09:35 user nova-compute[74701]:     <partition>/machine</partition>
Oct 20 13:09:35 user nova-compute[74701]:   </resource>
Oct 20 13:09:35 user nova-compute[74701]:   <sysinfo type='smbios'>
Oct 20 13:09:35 user nova-compute[74701]:     <system>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='version'>0.0.0</entry>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='serial'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='uuid'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:35 user nova-compute[74701]:       <entry name='family'>Virtual Machine</entry>
Oct 20 13:09:35 user nova-compute[74701]:     </system>
Oct 20 13:09:35 user nova-compute[74701]:   </sysinfo>
Oct 20 13:09:35 user nova-compute[74701]:   <os>
Oct 20 13:09:35 user nova-compute[74701]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 13:09:35 user nova-compute[74701]:     <boot dev='hd'/>
Oct 20 13:09:35 user nova-compute[74701]:     <smbios mode='sysinfo'/>
Oct 20 13:09:35 user nova-compute[74701]:   </os>
Oct 20 13:09:35 user nova-compute[74701]:   <features>
Oct 20 13:09:35 user nova-compute[74701]:     <acpi/>
Oct 20 13:09:35 user nova-compute[74701]:     <apic/>
Oct 20 13:09:35 user nova-compute[74701]:     <vmcoreinfo state='on'/>
Oct 20 13:09:35 user nova-compute[74701]:   </features>
Oct 20 13:09:35 user nova-compute[74701]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 13:09:35 user nova-compute[74701]:     <model fallback='forbid'>Nehalem</model>
Oct 20 13:09:35 user nova-compute[74701]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 13:09:35 user nova-compute[74701]:     <feature policy='require' name='vme'/>
Oct 20 13:09:35 user nova-compute[74701]:     <feature policy='require' name='x2apic'/>
Oct 20 13:09:35 user nova-compute[74701]:     <feature policy='require' name='hypervisor'/>
Oct 20 13:09:35 user nova-compute[74701]:   </cpu>
Oct 20 13:09:35 user nova-compute[74701]:   <clock offset='utc'>
Oct 20 13:09:35 user nova-compute[74701]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 13:09:35 user nova-compute[74701]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 13:09:35 user nova-compute[74701]:     <timer name='hpet' present='no'/>
Oct 20 13:09:35 user nova-compute[74701]:   </clock>
Oct 20 13:09:35 user nova-compute[74701]:   <on_poweroff>destroy</on_poweroff>
Oct 20 13:09:35 user nova-compute[74701]:   <on_reboot>restart</on_reboot>
Oct 20 13:09:35 user nova-compute[74701]:   <on_crash>destroy</on_crash>
Oct 20 13:09:35 user nova-compute[74701]:   <devices>
Oct 20 13:09:35 user nova-compute[74701]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 13:09:35 user nova-compute[74701]:     <disk type='file' device='disk'>
Oct 20 13:09:35 user nova-compute[74701]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 13:09:35 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk' index='2'/>
Oct 20 13:09:35 user nova-compute[74701]:       <backingStore type='file' index='3'>
Oct 20 13:09:35 user nova-compute[74701]:         <format type='raw'/>
Oct 20 13:09:35 user nova-compute[74701]:         <source file='/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b'/>
Oct 20 13:09:35 user nova-compute[74701]:         <backingStore/>
Oct 20 13:09:35 user nova-compute[74701]:       </backingStore>
Oct 20 13:09:35 user nova-compute[74701]:       <target dev='vda' bus='virtio'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='virtio-disk0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </disk>
Oct 20 13:09:35 user nova-compute[74701]:     <disk type='file' device='cdrom'>
Oct 20 13:09:35 user nova-compute[74701]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 13:09:35 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config' index='1'/>
Oct 20 13:09:35 user nova-compute[74701]:       <backingStore/>
Oct 20 13:09:35 user nova-compute[74701]:       <target dev='hda' bus='ide'/>
Oct 20 13:09:35 user nova-compute[74701]:       <readonly/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='ide0-0-0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </disk>
Oct 20 13:09:35 user nova-compute[74701]:     <controller type='usb' index='0' model='none'>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='usb'/>
Oct 20 13:09:35 user nova-compute[74701]:     </controller>
Oct 20 13:09:35 user nova-compute[74701]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='pci.0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </controller>
Oct 20 13:09:35 user nova-compute[74701]:     <controller type='ide' index='0'>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='ide'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 13:09:35 user nova-compute[74701]:     </controller>
Oct 20 13:09:35 user nova-compute[74701]:     <interface type='ethernet'>
Oct 20 13:09:35 user nova-compute[74701]:       <mac address='fa:16:3e:43:6c:95'/>
Oct 20 13:09:35 user nova-compute[74701]:       <target dev='tap5bae838d-7e'/>
Oct 20 13:09:35 user nova-compute[74701]:       <model type='virtio'/>
Oct 20 13:09:35 user nova-compute[74701]:       <mtu size='1442'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='net0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </interface>
Oct 20 13:09:35 user nova-compute[74701]:     <interface type='ethernet'>
Oct 20 13:09:35 user nova-compute[74701]:       <mac address='fa:16:3e:34:da:4e'/>
Oct 20 13:09:35 user nova-compute[74701]:       <target dev='tap9a30e219-d6'/>
Oct 20 13:09:35 user nova-compute[74701]:       <model type='virtio'/>
Oct 20 13:09:35 user nova-compute[74701]:       <mtu size='1442'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='net1'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </interface>
Oct 20 13:09:35 user nova-compute[74701]:     <serial type='pty'>
Oct 20 13:09:35 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:35 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:35 user nova-compute[74701]:       <target type='isa-serial' port='0'>
Oct 20 13:09:35 user nova-compute[74701]:         <model name='isa-serial'/>
Oct 20 13:09:35 user nova-compute[74701]:       </target>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </serial>
Oct 20 13:09:35 user nova-compute[74701]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 13:09:35 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:35 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:35 user nova-compute[74701]:       <target type='serial' port='0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </console>
Oct 20 13:09:35 user nova-compute[74701]:     <input type='mouse' bus='ps2'>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='input0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </input>
Oct 20 13:09:35 user nova-compute[74701]:     <input type='keyboard' bus='ps2'>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='input1'/>
Oct 20 13:09:35 user nova-compute[74701]:     </input>
Oct 20 13:09:35 user nova-compute[74701]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 13:09:35 user nova-compute[74701]:       <listen type='address' address='0.0.0.0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </graphics>
Oct 20 13:09:35 user nova-compute[74701]:     <audio id='1' type='none'/>
Oct 20 13:09:35 user nova-compute[74701]:     <video>
Oct 20 13:09:35 user nova-compute[74701]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='video0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </video>
Oct 20 13:09:35 user nova-compute[74701]:     <memballoon model='virtio'>
Oct 20 13:09:35 user nova-compute[74701]:       <stats period='10'/>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='balloon0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </memballoon>
Oct 20 13:09:35 user nova-compute[74701]:     <rng model='virtio'>
Oct 20 13:09:35 user nova-compute[74701]:       <backend model='random'>/dev/urandom</backend>
Oct 20 13:09:35 user nova-compute[74701]:       <alias name='rng0'/>
Oct 20 13:09:35 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 13:09:35 user nova-compute[74701]:     </rng>
Oct 20 13:09:35 user nova-compute[74701]:   </devices>
Oct 20 13:09:35 user nova-compute[74701]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 13:09:35 user nova-compute[74701]:     <label>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</label>
Oct 20 13:09:35 user nova-compute[74701]:     <imagelabel>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</imagelabel>
Oct 20 13:09:35 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:35 user nova-compute[74701]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 13:09:35 user nova-compute[74701]:     <label>+64055:+108</label>
Oct 20 13:09:35 user nova-compute[74701]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 13:09:35 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:35 user nova-compute[74701]: </domain>
Oct 20 13:09:35 user nova-compute[74701]:  {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 13:09:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully detached device tap9a30e219-d6 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the persistent domain config.
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] (1/8): Attempting to detach device tap9a30e219-d6 with device alias net1 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] detach device xml: <interface type="ethernet">
Oct 20 13:09:35 user nova-compute[74701]:   <mac address="fa:16:3e:34:da:4e"/>
Oct 20 13:09:35 user nova-compute[74701]:   <model type="virtio"/>
Oct 20 13:09:35 user nova-compute[74701]:   <mtu size="1442"/>
Oct 20 13:09:35 user nova-compute[74701]:   <target dev="tap9a30e219-d6"/>
Oct 20 13:09:35 user nova-compute[74701]: </interface>
Oct 20 13:09:35 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30a7dc-c1c2-464e-b214-2430f45dd9a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 (non-flash)
Oct 20 13:09:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02f7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034'): ({'sdi'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Removing single pathed devices sdi {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a29bbce-51be-4d00-ad17-6f117791deed]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad457ae-edb8-46ad-93fd-3eb87fa4c17b]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Flushing IO for device /dev/sdi {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d098f-27c9-4a68-b5e0-1cfbab6cd607]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4faf586-df2a-459d-984d-033a755323b5]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] SCSI volumes sdi have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[37420ffd-4984-42e8-bdc0-ccaef74764ff]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1801b-4165-4941-8dd5-3eef7104f8a2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260]
Oct 20 13:09:35 user nova-compute[74701]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8d807a-1a26-4c85-b1cf-9a8549f79034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b39a42-e631-4078-bb4c-d4b201a0281f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] <== disconnect_volume: return (398ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Start waiting for the detach event from libvirt for device tap9a30e219-d6 with device alias net1 for instance bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-unplugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-unplugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:36 user nova-compute[74701]: WARNING nova.compute.manager [req-5c7594c9-c745-41e4-8c79-19525cb130f8 req-aa8396e1-6ca0-4167-9859-e61fa2d3a106 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-unplugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c for instance with vm_state active and task_state None.
Oct 20 13:09:37 user nova-compute[74701]: DEBUG nova.objects.instance [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lazy-loading 'flavor' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2c2cefc9-5124-405d-9c9c-293d41a8fbf2 tempest-VolumesAssistedSnapshotsTest-311948660 tempest-VolumesAssistedSnapshotsTest-311948660-project-admin] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.097s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:38 user nova-compute[74701]: WARNING nova.compute.manager [req-5936168b-1b1b-4694-ac64-be635e0adda3 req-055f150b-bec0-4804-ba58-8792a34f9f1f service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c for instance with vm_state active and task_state None.
Oct 20 13:09:38 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'flavor' on Instance uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c63748d4-11e4-43a6-80f3-5b4699c0b3cd tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.731s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:40 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d5453469-c50d-41c0-a39b-a0d4d3add762 is timed out.
Oct 20 13:09:40 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Successfully detached device sdc from instance d5453469-c50d-41c0-a39b-a0d4d3add762 from the live domain config.
Oct 20 13:09:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhSjBHiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:40 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c8260-f23b-4665-b57c-5a074e11095c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:09:40 user nova-compute[74701]: No targets found.
Oct 20 13:09:40 user nova-compute[74701]: iSNS:
Oct 20 13:09:40 user nova-compute[74701]: No targets found.
Oct 20 13:09:40 user nova-compute[74701]: STATIC:
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:09:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:09:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:09:40 user nova-compute[74701]: FIRMWARE:
Oct 20 13:09:40 user nova-compute[74701]: No targets found.
Oct 20 13:09:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:09:40 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:09:40 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa68633-d030-403b-9b58-c08641c6baeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20491cb-fefe-4c21-a1dd-be12b98441e4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:09:40 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:09:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0106950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd'): ({'sdk'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Removing single pathed devices sdk {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039e1e4-dc67-456a-b60b-7f14148c6d71]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c640875-1a02-46af-8db4-2b8aec07b753]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Flushing IO for device /dev/sdk {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eadc0d-fa54-4e82-a667-997a2fe935c3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c23d2-8079-48b5-aac4-d3467d8db878]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] SCSI volumes sdk have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4272af-b919-46dd-b28b-48f4aa1e8814]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[695446fb-5431-4068-a138-776c9fd07f94]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260]
Oct 20 13:09:40 user nova-compute[74701]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd, portal: 172.16.0.220,3260] successful.
Oct 20 13:09:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8af1fc40-0463-44e6-a3c7-745fa05c17fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84d1eb-6b1f-415c-bf5c-8f0be74dd1d5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] <== disconnect_volume: return (368ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:09:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lazy-loading 'flavor' on Instance uuid 4f50c459-c21a-4050-9d1c-730a224c8cf9 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:48 user nova-compute[74701]: INFO nova.compute.manager [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Attaching volume f7ffc29e-97f9-41d3-92fe-434a31124cc7 to /dev/vdb
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.utils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[19336672-7196-42ce-82fa-945422d1666e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c7408-21cd-469c-b65d-dc819af1c7a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb038d46-c9d2-4be7-8183-9d5f148be3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afeb3a6-9794-44e4-befa-987f701cba5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:09:48 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:09:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae514e76-f4e6-4ad3-93b4-7f9222b71315]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG os_brick.utils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:09:48 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating existing volume attachment record: 9b0a156a-0999-4a59-baa1-16c5bdd8f728 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:09:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:09:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:09:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:09:55 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:09:55 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7395MB free_disk=25.28777313232422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d5453469-c50d-41c0-a39b-a0d4d3add762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bdb0629d-0150-445c-b842-52a1c0ebbd41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5b925b2-8341-4f1f-99d0-4a27ce9efe1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 304e7ddb-040e-4da7-8d52-1e183369827f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Waiting for libvirt event about the detach of device tap9a30e219-d6 with device alias net1 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 is timed out.
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 13:09:55 user nova-compute[74701]:   <name>instance-00000007</name>
Oct 20 13:09:55 user nova-compute[74701]:   <uuid>bdb0629d-0150-445c-b842-52a1c0ebbd41</uuid>
Oct 20 13:09:55 user nova-compute[74701]:   <metadata>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:55 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:08:25</nova:creationTime>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:55 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:55 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:55 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:port uuid="9a30e219-d69f-40ef-8dd7-452ad5cc0e5c">
Oct 20 13:09:55 user nova-compute[74701]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Oct 20 13:09:55 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:55 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:55 user nova-compute[74701]:   </metadata>
Oct 20 13:09:55 user nova-compute[74701]:   <memory unit='KiB'>524288</memory>
Oct 20 13:09:55 user nova-compute[74701]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 13:09:55 user nova-compute[74701]:   <vcpu placement='static'>1</vcpu>
Oct 20 13:09:55 user nova-compute[74701]:   <resource>
Oct 20 13:09:55 user nova-compute[74701]:     <partition>/machine</partition>
Oct 20 13:09:55 user nova-compute[74701]:   </resource>
Oct 20 13:09:55 user nova-compute[74701]:   <sysinfo type='smbios'>
Oct 20 13:09:55 user nova-compute[74701]:     <system>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='version'>0.0.0</entry>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='serial'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='uuid'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:55 user nova-compute[74701]:       <entry name='family'>Virtual Machine</entry>
Oct 20 13:09:55 user nova-compute[74701]:     </system>
Oct 20 13:09:55 user nova-compute[74701]:   </sysinfo>
Oct 20 13:09:55 user nova-compute[74701]:   <os>
Oct 20 13:09:55 user nova-compute[74701]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 13:09:55 user nova-compute[74701]:     <boot dev='hd'/>
Oct 20 13:09:55 user nova-compute[74701]:     <smbios mode='sysinfo'/>
Oct 20 13:09:55 user nova-compute[74701]:   </os>
Oct 20 13:09:55 user nova-compute[74701]:   <features>
Oct 20 13:09:55 user nova-compute[74701]:     <acpi/>
Oct 20 13:09:55 user nova-compute[74701]:     <apic/>
Oct 20 13:09:55 user nova-compute[74701]:     <vmcoreinfo state='on'/>
Oct 20 13:09:55 user nova-compute[74701]:   </features>
Oct 20 13:09:55 user nova-compute[74701]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 13:09:55 user nova-compute[74701]:     <model fallback='forbid'>Nehalem</model>
Oct 20 13:09:55 user nova-compute[74701]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 13:09:55 user nova-compute[74701]:     <feature policy='require' name='vme'/>
Oct 20 13:09:55 user nova-compute[74701]:     <feature policy='require' name='x2apic'/>
Oct 20 13:09:55 user nova-compute[74701]:     <feature policy='require' name='hypervisor'/>
Oct 20 13:09:55 user nova-compute[74701]:   </cpu>
Oct 20 13:09:55 user nova-compute[74701]:   <clock offset='utc'>
Oct 20 13:09:55 user nova-compute[74701]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 13:09:55 user nova-compute[74701]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 13:09:55 user nova-compute[74701]:     <timer name='hpet' present='no'/>
Oct 20 13:09:55 user nova-compute[74701]:   </clock>
Oct 20 13:09:55 user nova-compute[74701]:   <on_poweroff>destroy</on_poweroff>
Oct 20 13:09:55 user nova-compute[74701]:   <on_reboot>restart</on_reboot>
Oct 20 13:09:55 user nova-compute[74701]:   <on_crash>destroy</on_crash>
Oct 20 13:09:55 user nova-compute[74701]:   <devices>
Oct 20 13:09:55 user nova-compute[74701]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 13:09:55 user nova-compute[74701]:     <disk type='file' device='disk'>
Oct 20 13:09:55 user nova-compute[74701]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 13:09:55 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk' index='2'/>
Oct 20 13:09:55 user nova-compute[74701]:       <backingStore type='file' index='3'>
Oct 20 13:09:55 user nova-compute[74701]:         <format type='raw'/>
Oct 20 13:09:55 user nova-compute[74701]:         <source file='/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b'/>
Oct 20 13:09:55 user nova-compute[74701]:         <backingStore/>
Oct 20 13:09:55 user nova-compute[74701]:       </backingStore>
Oct 20 13:09:55 user nova-compute[74701]:       <target dev='vda' bus='virtio'/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='virtio-disk0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </disk>
Oct 20 13:09:55 user nova-compute[74701]:     <disk type='file' device='cdrom'>
Oct 20 13:09:55 user nova-compute[74701]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 13:09:55 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config' index='1'/>
Oct 20 13:09:55 user nova-compute[74701]:       <backingStore/>
Oct 20 13:09:55 user nova-compute[74701]:       <target dev='hda' bus='ide'/>
Oct 20 13:09:55 user nova-compute[74701]:       <readonly/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='ide0-0-0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </disk>
Oct 20 13:09:55 user nova-compute[74701]:     <controller type='usb' index='0' model='none'>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='usb'/>
Oct 20 13:09:55 user nova-compute[74701]:     </controller>
Oct 20 13:09:55 user nova-compute[74701]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='pci.0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </controller>
Oct 20 13:09:55 user nova-compute[74701]:     <controller type='ide' index='0'>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='ide'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 13:09:55 user nova-compute[74701]:     </controller>
Oct 20 13:09:55 user nova-compute[74701]:     <interface type='ethernet'>
Oct 20 13:09:55 user nova-compute[74701]:       <mac address='fa:16:3e:43:6c:95'/>
Oct 20 13:09:55 user nova-compute[74701]:       <target dev='tap5bae838d-7e'/>
Oct 20 13:09:55 user nova-compute[74701]:       <model type='virtio'/>
Oct 20 13:09:55 user nova-compute[74701]:       <mtu size='1442'/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='net0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </interface>
Oct 20 13:09:55 user nova-compute[74701]:     <serial type='pty'>
Oct 20 13:09:55 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:55 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:55 user nova-compute[74701]:       <target type='isa-serial' port='0'>
Oct 20 13:09:55 user nova-compute[74701]:         <model name='isa-serial'/>
Oct 20 13:09:55 user nova-compute[74701]:       </target>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </serial>
Oct 20 13:09:55 user nova-compute[74701]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 13:09:55 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:55 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:55 user nova-compute[74701]:       <target type='serial' port='0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </console>
Oct 20 13:09:55 user nova-compute[74701]:     <input type='mouse' bus='ps2'>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='input0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </input>
Oct 20 13:09:55 user nova-compute[74701]:     <input type='keyboard' bus='ps2'>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='input1'/>
Oct 20 13:09:55 user nova-compute[74701]:     </input>
Oct 20 13:09:55 user nova-compute[74701]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 13:09:55 user nova-compute[74701]:       <listen type='address' address='0.0.0.0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </graphics>
Oct 20 13:09:55 user nova-compute[74701]:     <audio id='1' type='none'/>
Oct 20 13:09:55 user nova-compute[74701]:     <video>
Oct 20 13:09:55 user nova-compute[74701]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='video0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </video>
Oct 20 13:09:55 user nova-compute[74701]:     <memballoon model='virtio'>
Oct 20 13:09:55 user nova-compute[74701]:       <stats period='10'/>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='balloon0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </memballoon>
Oct 20 13:09:55 user nova-compute[74701]:     <rng model='virtio'>
Oct 20 13:09:55 user nova-compute[74701]:       <backend model='random'>/dev/urandom</backend>
Oct 20 13:09:55 user nova-compute[74701]:       <alias name='rng0'/>
Oct 20 13:09:55 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 13:09:55 user nova-compute[74701]:     </rng>
Oct 20 13:09:55 user nova-compute[74701]:   </devices>
Oct 20 13:09:55 user nova-compute[74701]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 13:09:55 user nova-compute[74701]:     <label>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</label>
Oct 20 13:09:55 user nova-compute[74701]:     <imagelabel>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</imagelabel>
Oct 20 13:09:55 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:55 user nova-compute[74701]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 13:09:55 user nova-compute[74701]:     <label>+64055:+108</label>
Oct 20 13:09:55 user nova-compute[74701]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 13:09:55 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:55 user nova-compute[74701]: </domain>
Oct 20 13:09:55 user nova-compute[74701]:  {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 13:09:55 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully detached device tap9a30e219-d6 from instance bdb0629d-0150-445c-b842-52a1c0ebbd41 from the live domain config.
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG os_vif [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a30e219-d6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e587d535-994a-451f-88fc-14f4513e94e9) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:55 user nova-compute[74701]: INFO os_vif [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6')
Oct 20 13:09:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:55 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:09:55</nova:creationTime>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:55 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:55 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:55 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:55 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:55 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:55 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:55 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:55 user nova-compute[74701]:  {{(pid=74701) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-deleted-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:56 user nova-compute[74701]: INFO nova.compute.manager [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Neutron deleted interface 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c; detaching it from the instance and deleting it from the info cache
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquired lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.neutron [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.objects.instance [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Lazy-loading 'system_metadata' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.objects.instance [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Lazy-loading 'flavor' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.objects.base [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Object Instance<bdb0629d-0150-445c-b842-52a1c0ebbd41> lazy-loaded attributes: system_metadata,flavor {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 13:09:56 user nova-compute[74701]:   <name>instance-00000007</name>
Oct 20 13:09:56 user nova-compute[74701]:   <uuid>bdb0629d-0150-445c-b842-52a1c0ebbd41</uuid>
Oct 20 13:09:56 user nova-compute[74701]:   <metadata>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:56 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:09:55</nova:creationTime>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:56 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:56 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:56 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:56 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:56 user nova-compute[74701]:   </metadata>
Oct 20 13:09:56 user nova-compute[74701]:   <memory unit='KiB'>524288</memory>
Oct 20 13:09:56 user nova-compute[74701]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 13:09:56 user nova-compute[74701]:   <vcpu placement='static'>1</vcpu>
Oct 20 13:09:56 user nova-compute[74701]:   <resource>
Oct 20 13:09:56 user nova-compute[74701]:     <partition>/machine</partition>
Oct 20 13:09:56 user nova-compute[74701]:   </resource>
Oct 20 13:09:56 user nova-compute[74701]:   <sysinfo type='smbios'>
Oct 20 13:09:56 user nova-compute[74701]:     <system>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='version'>0.0.0</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='serial'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='uuid'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='family'>Virtual Machine</entry>
Oct 20 13:09:56 user nova-compute[74701]:     </system>
Oct 20 13:09:56 user nova-compute[74701]:   </sysinfo>
Oct 20 13:09:56 user nova-compute[74701]:   <os>
Oct 20 13:09:56 user nova-compute[74701]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 13:09:56 user nova-compute[74701]:     <boot dev='hd'/>
Oct 20 13:09:56 user nova-compute[74701]:     <smbios mode='sysinfo'/>
Oct 20 13:09:56 user nova-compute[74701]:   </os>
Oct 20 13:09:56 user nova-compute[74701]:   <features>
Oct 20 13:09:56 user nova-compute[74701]:     <acpi/>
Oct 20 13:09:56 user nova-compute[74701]:     <apic/>
Oct 20 13:09:56 user nova-compute[74701]:     <vmcoreinfo state='on'/>
Oct 20 13:09:56 user nova-compute[74701]:   </features>
Oct 20 13:09:56 user nova-compute[74701]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 13:09:56 user nova-compute[74701]:     <model fallback='forbid'>Nehalem</model>
Oct 20 13:09:56 user nova-compute[74701]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='vme'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='x2apic'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='hypervisor'/>
Oct 20 13:09:56 user nova-compute[74701]:   </cpu>
Oct 20 13:09:56 user nova-compute[74701]:   <clock offset='utc'>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='hpet' present='no'/>
Oct 20 13:09:56 user nova-compute[74701]:   </clock>
Oct 20 13:09:56 user nova-compute[74701]:   <on_poweroff>destroy</on_poweroff>
Oct 20 13:09:56 user nova-compute[74701]:   <on_reboot>restart</on_reboot>
Oct 20 13:09:56 user nova-compute[74701]:   <on_crash>destroy</on_crash>
Oct 20 13:09:56 user nova-compute[74701]:   <devices>
Oct 20 13:09:56 user nova-compute[74701]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 13:09:56 user nova-compute[74701]:     <disk type='file' device='disk'>
Oct 20 13:09:56 user nova-compute[74701]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 13:09:56 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk' index='2'/>
Oct 20 13:09:56 user nova-compute[74701]:       <backingStore type='file' index='3'>
Oct 20 13:09:56 user nova-compute[74701]:         <format type='raw'/>
Oct 20 13:09:56 user nova-compute[74701]:         <source file='/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b'/>
Oct 20 13:09:56 user nova-compute[74701]:         <backingStore/>
Oct 20 13:09:56 user nova-compute[74701]:       </backingStore>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='vda' bus='virtio'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='virtio-disk0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </disk>
Oct 20 13:09:56 user nova-compute[74701]:     <disk type='file' device='cdrom'>
Oct 20 13:09:56 user nova-compute[74701]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 13:09:56 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config' index='1'/>
Oct 20 13:09:56 user nova-compute[74701]:       <backingStore/>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='hda' bus='ide'/>
Oct 20 13:09:56 user nova-compute[74701]:       <readonly/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='ide0-0-0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </disk>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='usb' index='0' model='none'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='usb'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='pci.0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='ide' index='0'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='ide'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <interface type='ethernet'>
Oct 20 13:09:56 user nova-compute[74701]:       <mac address='fa:16:3e:43:6c:95'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='tap5bae838d-7e'/>
Oct 20 13:09:56 user nova-compute[74701]:       <model type='virtio'/>
Oct 20 13:09:56 user nova-compute[74701]:       <mtu size='1442'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='net0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </interface>
Oct 20 13:09:56 user nova-compute[74701]:     <serial type='pty'>
Oct 20 13:09:56 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:56 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target type='isa-serial' port='0'>
Oct 20 13:09:56 user nova-compute[74701]:         <model name='isa-serial'/>
Oct 20 13:09:56 user nova-compute[74701]:       </target>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </serial>
Oct 20 13:09:56 user nova-compute[74701]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 13:09:56 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:56 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target type='serial' port='0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </console>
Oct 20 13:09:56 user nova-compute[74701]:     <input type='mouse' bus='ps2'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='input0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </input>
Oct 20 13:09:56 user nova-compute[74701]:     <input type='keyboard' bus='ps2'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='input1'/>
Oct 20 13:09:56 user nova-compute[74701]:     </input>
Oct 20 13:09:56 user nova-compute[74701]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 13:09:56 user nova-compute[74701]:       <listen type='address' address='0.0.0.0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </graphics>
Oct 20 13:09:56 user nova-compute[74701]:     <audio id='1' type='none'/>
Oct 20 13:09:56 user nova-compute[74701]:     <video>
Oct 20 13:09:56 user nova-compute[74701]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='video0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </video>
Oct 20 13:09:56 user nova-compute[74701]:     <memballoon model='virtio'>
Oct 20 13:09:56 user nova-compute[74701]:       <stats period='10'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='balloon0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </memballoon>
Oct 20 13:09:56 user nova-compute[74701]:     <rng model='virtio'>
Oct 20 13:09:56 user nova-compute[74701]:       <backend model='random'>/dev/urandom</backend>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='rng0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </rng>
Oct 20 13:09:56 user nova-compute[74701]:   </devices>
Oct 20 13:09:56 user nova-compute[74701]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 13:09:56 user nova-compute[74701]:     <label>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</label>
Oct 20 13:09:56 user nova-compute[74701]:     <imagelabel>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</imagelabel>
Oct 20 13:09:56 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:56 user nova-compute[74701]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 13:09:56 user nova-compute[74701]:     <label>+64055:+108</label>
Oct 20 13:09:56 user nova-compute[74701]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 13:09:56 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:56 user nova-compute[74701]: </domain>
Oct 20 13:09:56 user nova-compute[74701]:  {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface> {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:da:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9a30e219-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 13:09:56 user nova-compute[74701]:   <name>instance-00000007</name>
Oct 20 13:09:56 user nova-compute[74701]:   <uuid>bdb0629d-0150-445c-b842-52a1c0ebbd41</uuid>
Oct 20 13:09:56 user nova-compute[74701]:   <metadata>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:56 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:09:55</nova:creationTime>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:56 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:56 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:56 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:56 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:56 user nova-compute[74701]:   </metadata>
Oct 20 13:09:56 user nova-compute[74701]:   <memory unit='KiB'>524288</memory>
Oct 20 13:09:56 user nova-compute[74701]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 13:09:56 user nova-compute[74701]:   <vcpu placement='static'>1</vcpu>
Oct 20 13:09:56 user nova-compute[74701]:   <resource>
Oct 20 13:09:56 user nova-compute[74701]:     <partition>/machine</partition>
Oct 20 13:09:56 user nova-compute[74701]:   </resource>
Oct 20 13:09:56 user nova-compute[74701]:   <sysinfo type='smbios'>
Oct 20 13:09:56 user nova-compute[74701]:     <system>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='version'>0.0.0</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='serial'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='uuid'>bdb0629d-0150-445c-b842-52a1c0ebbd41</entry>
Oct 20 13:09:56 user nova-compute[74701]:       <entry name='family'>Virtual Machine</entry>
Oct 20 13:09:56 user nova-compute[74701]:     </system>
Oct 20 13:09:56 user nova-compute[74701]:   </sysinfo>
Oct 20 13:09:56 user nova-compute[74701]:   <os>
Oct 20 13:09:56 user nova-compute[74701]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 13:09:56 user nova-compute[74701]:     <boot dev='hd'/>
Oct 20 13:09:56 user nova-compute[74701]:     <smbios mode='sysinfo'/>
Oct 20 13:09:56 user nova-compute[74701]:   </os>
Oct 20 13:09:56 user nova-compute[74701]:   <features>
Oct 20 13:09:56 user nova-compute[74701]:     <acpi/>
Oct 20 13:09:56 user nova-compute[74701]:     <apic/>
Oct 20 13:09:56 user nova-compute[74701]:     <vmcoreinfo state='on'/>
Oct 20 13:09:56 user nova-compute[74701]:   </features>
Oct 20 13:09:56 user nova-compute[74701]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 13:09:56 user nova-compute[74701]:     <model fallback='forbid'>Nehalem</model>
Oct 20 13:09:56 user nova-compute[74701]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='vme'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='x2apic'/>
Oct 20 13:09:56 user nova-compute[74701]:     <feature policy='require' name='hypervisor'/>
Oct 20 13:09:56 user nova-compute[74701]:   </cpu>
Oct 20 13:09:56 user nova-compute[74701]:   <clock offset='utc'>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 13:09:56 user nova-compute[74701]:     <timer name='hpet' present='no'/>
Oct 20 13:09:56 user nova-compute[74701]:   </clock>
Oct 20 13:09:56 user nova-compute[74701]:   <on_poweroff>destroy</on_poweroff>
Oct 20 13:09:56 user nova-compute[74701]:   <on_reboot>restart</on_reboot>
Oct 20 13:09:56 user nova-compute[74701]:   <on_crash>destroy</on_crash>
Oct 20 13:09:56 user nova-compute[74701]:   <devices>
Oct 20 13:09:56 user nova-compute[74701]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 13:09:56 user nova-compute[74701]:     <disk type='file' device='disk'>
Oct 20 13:09:56 user nova-compute[74701]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 13:09:56 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk' index='2'/>
Oct 20 13:09:56 user nova-compute[74701]:       <backingStore type='file' index='3'>
Oct 20 13:09:56 user nova-compute[74701]:         <format type='raw'/>
Oct 20 13:09:56 user nova-compute[74701]:         <source file='/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b'/>
Oct 20 13:09:56 user nova-compute[74701]:         <backingStore/>
Oct 20 13:09:56 user nova-compute[74701]:       </backingStore>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='vda' bus='virtio'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='virtio-disk0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </disk>
Oct 20 13:09:56 user nova-compute[74701]:     <disk type='file' device='cdrom'>
Oct 20 13:09:56 user nova-compute[74701]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 13:09:56 user nova-compute[74701]:       <source file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/disk.config' index='1'/>
Oct 20 13:09:56 user nova-compute[74701]:       <backingStore/>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='hda' bus='ide'/>
Oct 20 13:09:56 user nova-compute[74701]:       <readonly/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='ide0-0-0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </disk>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='usb' index='0' model='none'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='usb'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='pci.0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <controller type='ide' index='0'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='ide'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 13:09:56 user nova-compute[74701]:     </controller>
Oct 20 13:09:56 user nova-compute[74701]:     <interface type='ethernet'>
Oct 20 13:09:56 user nova-compute[74701]:       <mac address='fa:16:3e:43:6c:95'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target dev='tap5bae838d-7e'/>
Oct 20 13:09:56 user nova-compute[74701]:       <model type='virtio'/>
Oct 20 13:09:56 user nova-compute[74701]:       <mtu size='1442'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='net0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </interface>
Oct 20 13:09:56 user nova-compute[74701]:     <serial type='pty'>
Oct 20 13:09:56 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:56 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target type='isa-serial' port='0'>
Oct 20 13:09:56 user nova-compute[74701]:         <model name='isa-serial'/>
Oct 20 13:09:56 user nova-compute[74701]:       </target>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </serial>
Oct 20 13:09:56 user nova-compute[74701]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 13:09:56 user nova-compute[74701]:       <source path='/dev/pts/6'/>
Oct 20 13:09:56 user nova-compute[74701]:       <log file='/opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41/console.log' append='off'/>
Oct 20 13:09:56 user nova-compute[74701]:       <target type='serial' port='0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='serial0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </console>
Oct 20 13:09:56 user nova-compute[74701]:     <input type='mouse' bus='ps2'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='input0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </input>
Oct 20 13:09:56 user nova-compute[74701]:     <input type='keyboard' bus='ps2'>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='input1'/>
Oct 20 13:09:56 user nova-compute[74701]:     </input>
Oct 20 13:09:56 user nova-compute[74701]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 13:09:56 user nova-compute[74701]:       <listen type='address' address='0.0.0.0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </graphics>
Oct 20 13:09:56 user nova-compute[74701]:     <audio id='1' type='none'/>
Oct 20 13:09:56 user nova-compute[74701]:     <video>
Oct 20 13:09:56 user nova-compute[74701]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='video0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </video>
Oct 20 13:09:56 user nova-compute[74701]:     <memballoon model='virtio'>
Oct 20 13:09:56 user nova-compute[74701]:       <stats period='10'/>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='balloon0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </memballoon>
Oct 20 13:09:56 user nova-compute[74701]:     <rng model='virtio'>
Oct 20 13:09:56 user nova-compute[74701]:       <backend model='random'>/dev/urandom</backend>
Oct 20 13:09:56 user nova-compute[74701]:       <alias name='rng0'/>
Oct 20 13:09:56 user nova-compute[74701]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 13:09:56 user nova-compute[74701]:     </rng>
Oct 20 13:09:56 user nova-compute[74701]:   </devices>
Oct 20 13:09:56 user nova-compute[74701]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 13:09:56 user nova-compute[74701]:     <label>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</label>
Oct 20 13:09:56 user nova-compute[74701]:     <imagelabel>libvirt-bdb0629d-0150-445c-b842-52a1c0ebbd41</imagelabel>
Oct 20 13:09:56 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:56 user nova-compute[74701]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 13:09:56 user nova-compute[74701]:     <label>+64055:+108</label>
Oct 20 13:09:56 user nova-compute[74701]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 13:09:56 user nova-compute[74701]:   </seclabel>
Oct 20 13:09:56 user nova-compute[74701]: </domain>
Oct 20 13:09:56 user nova-compute[74701]:  {{(pid=74701) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 13:09:56 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Detaching interface fa:16:3e:34:da:4e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap9a30e219-d6' not found.
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Converting VIF {"id": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "address": "fa:16:3e:34:da:4e", "network": {"id": "89a8d1d2-018d-4fd0-8554-b8c1bdf6213c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-219627539", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a30e219-d6", "ovs_interfaceid": "9a30e219-d69f-40ef-8dd7-452ad5cc0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.network.os_vif_util [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG os_vif [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a30e219-d6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:09:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:09:56 user nova-compute[74701]: INFO os_vif [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=9a30e219-d69f-40ef-8dd7-452ad5cc0e5c,network=Network(89a8d1d2-018d-4fd0-8554-b8c1bdf6213c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a30e219-d6')
Oct 20 13:09:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [req-d37a3f5a-6dcb-465d-9987-9a28a45657e1 req-279aac6f-33f2-450c-a1ff-ed08d4306ef0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:09:56 user nova-compute[74701]:   <nova:package version="0.0.0"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:name>tempest-device-tagging-server-1538760454</nova:name>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:creationTime>2023-10-20 13:09:56</nova:creationTime>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:flavor name="m1.tiny">
Oct 20 13:09:56 user nova-compute[74701]:     <nova:memory>512</nova:memory>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:disk>1</nova:disk>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:swap>0</nova:swap>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:vcpus>1</nova:vcpus>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:flavor>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:user uuid="b3350fab957a47ea9f835198cbd20119">tempest-TaggedAttachmentsTest-1382218452-project-member</nova:user>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:project uuid="a3d7907705534cadabf146dd7de662d0">tempest-TaggedAttachmentsTest-1382218452</nova:project>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:owner>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:09:56 user nova-compute[74701]:   <nova:ports>
Oct 20 13:09:56 user nova-compute[74701]:     <nova:port uuid="5bae838d-7ebc-4362-bf9b-fd2b22dde080">
Oct 20 13:09:56 user nova-compute[74701]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:09:56 user nova-compute[74701]:     </nova:port>
Oct 20 13:09:56 user nova-compute[74701]:   </nova:ports>
Oct 20 13:09:56 user nova-compute[74701]: </nova:instance>
Oct 20 13:09:56 user nova-compute[74701]:  {{(pid=74701) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:09:57 user nova-compute[74701]: INFO nova.network.neutron [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Port 9a30e219-d69f-40ef-8dd7-452ad5cc0e5c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [{"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Releasing lock "refresh_cache-bdb0629d-0150-445c-b842-52a1c0ebbd41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-2354f65f-761e-4357-ac83-836e50c7ed55 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "interface-bdb0629d-0150-445c-b842-52a1c0ebbd41-9a30e219-d69f-40ef-8dd7-452ad5cc0e5c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.775s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating instance_info_cache with network_info: [{"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4f50c459-c21a-4050-9d1c-730a224c8cf9" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lazy-loading 'flavor' on Instance uuid d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:09:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8fbe7bb9-eb71-47aa-807b-3fcc7a191eda tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.938s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.volume.cinder [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Update attachment failed for attachment 9b0a156a-0999-4a59-baa1-16c5bdd8f728. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Failed to attach f7ffc29e-97f9-41d3-92fe-434a31124cc7 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Traceback (most recent call last):
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     self._do_attach(context, instance, volume, volume_api,
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     self._volume_attach(context, volume, connector, instance,
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     connection_info = volume_api.attachment_update(
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     res = method(self, ctx, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     return method.func(obj, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     resp = self._update('/attachments/%s' % id, body)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     return self.request(url, method, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9]     raise exceptions.from_response(resp, body)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776)
Oct 20 13:09:58 user nova-compute[74701]: ERROR nova.compute.manager [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] 
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.729s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server [None req-97af1a61-5c07-41d2-8e10-841e602d34fd tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19ba09b2-df64-4e5b-9962-6bcfc4253776)
Oct 20 13:09:58 user nova-compute[74701]: ERROR oslo_messaging.rpc.server 
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:58 user nova-compute[74701]: INFO nova.compute.manager [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Terminating instance
Oct 20 13:09:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-unplugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] No waiting events found dispatching network-vif-unplugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:09:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-132a05e0-5f54-43c1-8b9e-3bbaedf6147c req-cddb28de-d7de-4cf0-afe8-9d7260f2ce0b service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-unplugged-f3292852-36fd-437d-bd66-28f5403e3cf4 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Instance destroyed successfully.
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lazy-loading 'resources' on Instance uuid d5453469-c50d-41c0-a39b-a0d4d3add762 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1663521948',display_name='tempest-AttachSCSIVolumeTestJSON-server-1663521948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1663521948',id=6,image_ref='ed53af54-0448-4bd6-9049-b4817673931b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV4WLEjAlSXE8zApAjP/0xkeFaVbm9lsfiU4dSJwma0upjIQHrBQQSlV9GzqVHSND6vjJ1dHw9LV/ue7PIOPhEOkCI0/hFDLj31JRKTHo2CIXvFfjBD3fR8/j058w0yjA==',key_name='tempest-keypair-641217935',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f488ba901ff54233ad1c76fe275e686b',ramdisk_id='',reservation_id='r-b0e2sqbd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed53af54-0448-4bd6-9049-b4817673931b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1878732776',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1878732776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dba610d54304e97a821cfbc8a9afdf7',uuid=d5453469-c50d-41c0-a39b-a0d4d3add762,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converting VIF {"id": "f3292852-36fd-437d-bd66-28f5403e3cf4", "address": "fa:16:3e:91:57:3e", "network": {"id": "3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-714365531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f488ba901ff54233ad1c76fe275e686b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3292852-36", "ovs_interfaceid": "f3292852-36fd-437d-bd66-28f5403e3cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG os_vif [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3292852-36, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e88d3f94-f990-43be-9945-d6da48fba97d) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:00 user nova-compute[74701]: INFO os_vif [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:3e,bridge_name='br-int',has_traffic_filtering=True,id=f3292852-36fd-437d-bd66-28f5403e3cf4,network=Network(3f8ae9c3-e63c-4f45-a384-a1a58e47ca6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3292852-36')
Oct 20 13:10:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Deleting instance files /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762_del
Oct 20 13:10:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Deletion of /opt/stack/data/nova/instances/d5453469-c50d-41c0-a39b-a0d4d3add762_del complete
Oct 20 13:10:00 user nova-compute[74701]: INFO nova.compute.manager [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:00 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:00 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:01 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Took 0.78 seconds to deallocate network for instance.
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-6baa2525-7444-4811-9f1a-3c3e130886bd req-bf137e41-9ab2-4079-8bd4-c6cf41a3f842 service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-deleted-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:01 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Deleted allocations for instance d5453469-c50d-41c0-a39b-a0d4d3add762
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] Acquiring lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] No waiting events found dispatching network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:01 user nova-compute[74701]: WARNING nova.compute.manager [req-b938ac3b-9a20-4071-9a7d-20baae929333 req-a096f091-0926-4b8c-81a7-27b97bd23c0d service nova] [instance: d5453469-c50d-41c0-a39b-a0d4d3add762] Received unexpected event network-vif-plugged-f3292852-36fd-437d-bd66-28f5403e3cf4 for instance with vm_state deleted and task_state None.
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-efcc1609-85d4-4acc-a1cf-deb8eb6d1e49 tempest-AttachSCSIVolumeTestJSON-1878732776 tempest-AttachSCSIVolumeTestJSON-1878732776-project-member] Lock "d5453469-c50d-41c0-a39b-a0d4d3add762" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:10:02 user nova-compute[74701]: INFO nova.compute.claims [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Claim successful on node user
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:10:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:10:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Creating image(s)
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "/opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "/opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG nova.policy [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e643924dcc704c3bacad93ee0dd803dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d3196b12fd43c183b0b9e8324efa5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:10:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk 1073741824" returned: 0 in 0.052s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Successfully created port: 98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Cannot resize image /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Ensure instance console log exists: /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Successfully updated port: 98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquired lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-changed-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Refreshing instance network info cache due to event network-changed-98aa958f-d2c1-4f86-81dd-79473e3cf626. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] Acquiring lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Updating instance_info_cache with network_info: [{"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Releasing lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Instance network_info: |[{"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] Acquired lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Refreshing network info cache for port 98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Start _get_guest_xml network_info=[{"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:10:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-686995556',display_name='tempest-VolumesAdminNegativeTest-server-686995556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-686995556',id=13,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-63i820xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:10:03Z,user_data=None,user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=cc61b092-3ef4-4b20-b02e-c8bb16586306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.objects.instance [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'pci_devices' on Instance uuid cc61b092-3ef4-4b20-b02e-c8bb16586306 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:10:04 user nova-compute[74701]:   <uuid>cc61b092-3ef4-4b20-b02e-c8bb16586306</uuid>
Oct 20 13:10:04 user nova-compute[74701]:   <name>instance-0000000d</name>
Oct 20 13:10:04 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:10:04 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:10:04 user nova-compute[74701]:   <metadata>
Oct 20 13:10:04 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:10:04 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:name>tempest-VolumesAdminNegativeTest-server-686995556</nova:name>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:10:04</nova:creationTime>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:10:04 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:10:04 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:owner>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:user uuid="e643924dcc704c3bacad93ee0dd803dc">tempest-VolumesAdminNegativeTest-245051053-project-member</nova:user>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:project uuid="04d3196b12fd43c183b0b9e8324efa5c">tempest-VolumesAdminNegativeTest-245051053</nova:project>
Oct 20 13:10:04 user nova-compute[74701]:       </nova:owner>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:10:04 user nova-compute[74701]:       <nova:ports>
Oct 20 13:10:04 user nova-compute[74701]:         <nova:port uuid="98aa958f-d2c1-4f86-81dd-79473e3cf626">
Oct 20 13:10:04 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 13:10:04 user nova-compute[74701]:         </nova:port>
Oct 20 13:10:04 user nova-compute[74701]:       </nova:ports>
Oct 20 13:10:04 user nova-compute[74701]:     </nova:instance>
Oct 20 13:10:04 user nova-compute[74701]:   </metadata>
Oct 20 13:10:04 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:10:04 user nova-compute[74701]:     <system>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="serial">cc61b092-3ef4-4b20-b02e-c8bb16586306</entry>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="uuid">cc61b092-3ef4-4b20-b02e-c8bb16586306</entry>
Oct 20 13:10:04 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:10:04 user nova-compute[74701]:     </system>
Oct 20 13:10:04 user nova-compute[74701]:   </sysinfo>
Oct 20 13:10:04 user nova-compute[74701]:   <os>
Oct 20 13:10:04 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:10:04 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:10:04 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:10:04 user nova-compute[74701]:   </os>
Oct 20 13:10:04 user nova-compute[74701]:   <features>
Oct 20 13:10:04 user nova-compute[74701]:     <acpi/>
Oct 20 13:10:04 user nova-compute[74701]:     <apic/>
Oct 20 13:10:04 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:10:04 user nova-compute[74701]:   </features>
Oct 20 13:10:04 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:10:04 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:10:04 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:10:04 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:10:04 user nova-compute[74701]:   </clock>
Oct 20 13:10:04 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:10:04 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:10:04 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:10:04 user nova-compute[74701]:   </cpu>
Oct 20 13:10:04 user nova-compute[74701]:   <devices>
Oct 20 13:10:04 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:10:04 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:10:04 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk"/>
Oct 20 13:10:04 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:10:04 user nova-compute[74701]:     </disk>
Oct 20 13:10:04 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:10:04 user nova-compute[74701]:       <mac address="fa:16:3e:db:cf:fc"/>
Oct 20 13:10:04 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:04 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:10:04 user nova-compute[74701]:       <target dev="tap98aa958f-d2"/>
Oct 20 13:10:04 user nova-compute[74701]:     </interface>
Oct 20 13:10:04 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:10:04 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/console.log" append="off"/>
Oct 20 13:10:04 user nova-compute[74701]:     </serial>
Oct 20 13:10:04 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:10:04 user nova-compute[74701]:     <video>
Oct 20 13:10:04 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:04 user nova-compute[74701]:     </video>
Oct 20 13:10:04 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:10:04 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:10:04 user nova-compute[74701]:     </rng>
Oct 20 13:10:04 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:10:04 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:10:04 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:10:04 user nova-compute[74701]:     </memballoon>
Oct 20 13:10:04 user nova-compute[74701]:   </devices>
Oct 20 13:10:04 user nova-compute[74701]: </domain>
Oct 20 13:10:04 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-686995556',display_name='tempest-VolumesAdminNegativeTest-server-686995556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-686995556',id=13,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-63i820xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:10:03Z,user_data=None,user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=cc61b092-3ef4-4b20-b02e-c8bb16586306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG os_vif [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '461df831-6a0d-5fb1-aeb5-1cda2f317de7', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98aa958f-d2, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98aa958f-d2, col_values=(('qos', UUID('a2fe3b09-6ca8-4cbe-a8a5-b8dd708ea503')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98aa958f-d2, col_values=(('external_ids', {'iface-id': '98aa958f-d2c1-4f86-81dd-79473e3cf626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:cf:fc', 'vm-uuid': 'cc61b092-3ef4-4b20-b02e-c8bb16586306'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:04 user nova-compute[74701]: INFO os_vif [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2')
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] No VIF found with MAC fa:16:3e:db:cf:fc, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Updated VIF entry in instance network info cache for port 98aa958f-d2c1-4f86-81dd-79473e3cf626. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Updating instance_info_cache with network_info: [{"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7c906c1-7d81-424a-8ef4-a89dafc6b45f req-0ef6e704-1a3f-4b08-94c0-a86d801364f0 service nova] Releasing lock "refresh_cache-cc61b092-3ef4-4b20-b02e-c8bb16586306" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.020s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] No waiting events found dispatching network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:06 user nova-compute[74701]: WARNING nova.compute.manager [req-3b349a1e-b439-4cc2-ae38-673d08e0bc9e req-5a0e1800-2977-470c-b86d-435a1889dd83 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received unexpected event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 for instance with vm_state building and task_state spawning.
Oct 20 13:10:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] No waiting events found dispatching network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:08 user nova-compute[74701]: WARNING nova.compute.manager [req-2e571724-0713-4b3e-8b24-9f636113ec86 req-4b060a96-63b2-4f16-abea-081dd780d0fe service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received unexpected event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 for instance with vm_state building and task_state spawning.
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:10:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Instance spawned successfully.
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:08 user nova-compute[74701]: INFO nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 20 13:10:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:10:08 user nova-compute[74701]: INFO nova.compute.manager [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Took 6.47 seconds to build instance.
Oct 20 13:10:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e572b566-f47b-4fa8-9c73-a11ccab93cb9 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.594s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:16 user nova-compute[74701]: INFO nova.compute.manager [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Terminating instance
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-unplugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] No waiting events found dispatching network-vif-unplugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-82148333-f358-47a5-94b0-aec33a2389fc req-d09cd809-d882-433b-9a8a-e8333ed9952c service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-unplugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-changed-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing instance network info cache due to event network-changed-e8b7060d-22e1-4259-81f0-e1be95abc54b. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] Acquiring lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] Acquired lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Refreshing network info cache for port e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:10:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Instance destroyed successfully.
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lazy-loading 'resources' on Instance uuid c01fac28-bf12-407e-a7a2-bc2a4ed68e1c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1726226158',display_name='tempest-VolumesAssistedSnapshotsTest-server-1726226158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1726226158',id=8,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg18WU3BhbayL1aGnUknL+Y9rJCQY7u4aFut1/8pTEJTgB7tOHTtihISnwERBCYu2mdwl4Slht5Cehv6Qt05CxOSFmRGj/qlS+hpX/pTnrDDT7H5JjbCDWowIXgO2eo3Q==',key_name='tempest-keypair-1386769552',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9de6880430d4533ac42bd43030b7b55',ramdisk_id='',reservation_id='r-2vi992d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-703313000',owner_user_name='tempest-VolumesAssistedSnapshotsTest-703313000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099facfc8bbd44b4bb043c70c885fe93',uuid=c01fac28-bf12-407e-a7a2-bc2a4ed68e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converting VIF {"id": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "address": "fa:16:3e:31:f7:63", "network": {"id": "808582a3-aee9-49b5-a2ad-83b3889fe9a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-403199642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9de6880430d4533ac42bd43030b7b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ce411f-c6", "ovs_interfaceid": "f6ce411f-c69c-476b-8018-78ed8fc2c90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_vif [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6ce411f-c6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c3635bb-c92a-44ed-bc59-14655ca3ebc7) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:17 user nova-compute[74701]: INFO os_vif [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=f6ce411f-c69c-476b-8018-78ed8fc2c90a,network=Network(808582a3-aee9-49b5-a2ad-83b3889fe9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ce411f-c6')
Oct 20 13:10:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Deleting instance files /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c_del
Oct 20 13:10:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Deletion of /opt/stack/data/nova/instances/c01fac28-bf12-407e-a7a2-bc2a4ed68e1c_del complete
Oct 20 13:10:17 user nova-compute[74701]: INFO nova.compute.manager [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-8cebb8a5-88ac-40a3-a070-5d761d7673ea req-f922d85a-79b4-41f7-bd99-89804f2c1f94 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event volume-reimaged-8130bccf-b499-4013-a02e-294619154a38 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8cebb8a5-88ac-40a3-a070-5d761d7673ea req-f922d85a-79b4-41f7-bd99-89804f2c1f94 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8cebb8a5-88ac-40a3-a070-5d761d7673ea req-f922d85a-79b4-41f7-bd99-89804f2c1f94 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8cebb8a5-88ac-40a3-a070-5d761d7673ea req-f922d85a-79b4-41f7-bd99-89804f2c1f94 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-8cebb8a5-88ac-40a3-a070-5d761d7673ea req-f922d85a-79b4-41f7-bd99-89804f2c1f94 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Processing event volume-reimaged-8130bccf-b499-4013-a02e-294619154a38 {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance event wait completed in 59 seconds for volume-reimaged {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:10:17 user nova-compute[74701]: INFO nova.virt.block_device [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Booting with volume 8130bccf-b499-4013-a02e-294619154a38 at /dev/vda
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.utils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab145457-9fcc-4540-87ef-e2f7a5785a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[675eb3c0-ce88-40f5-98b5-dd57ab84fca7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7b4bcc-1038-4c09-9189-e75d1e3b55a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eeb475-4188-4be4-9ee4-369d4c454371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.network.neutron [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updated VIF entry in instance network info cache for port e8b7060d-22e1-4259-81f0-e1be95abc54b. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.network.neutron [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5c608aa-e858-4573-847e-0bbb7b725206 req-eaddeea8-5636-41b7-95dd-16c9409eb472 service nova] Releasing lock "refresh_cache-71b23879-5dfd-44df-b6ca-6abad87aefa3" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:10:17 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:10:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7446086e-7065-4984-88cb-ca4bdfcd8865]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG os_brick.utils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:17 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating existing volume attachment record: 841ea60b-8982-4d71-b2da-2c8f14aa5451 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] Acquiring lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] No waiting events found dispatching network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:18 user nova-compute[74701]: WARNING nova.compute.manager [req-cadcce1a-196f-4f7b-9692-4cb4ce44bcc7 req-4653b158-70e1-4297-bd92-269aba22b21e service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received unexpected event network-vif-plugged-f6ce411f-c69c-476b-8018-78ed8fc2c90a for instance with vm_state active and task_state deleting.
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-63f94b63-08d0-485f-abdd-43e854c31f15 req-b9409047-0256-4397-a71f-7218862cc817 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Received event network-vif-deleted-f6ce411f-c69c-476b-8018-78ed8fc2c90a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:18 user nova-compute[74701]: INFO nova.compute.manager [req-63f94b63-08d0-485f-abdd-43e854c31f15 req-b9409047-0256-4397-a71f-7218862cc817 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Neutron deleted interface f6ce411f-c69c-476b-8018-78ed8fc2c90a; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.network.neutron [req-63f94b63-08d0-485f-abdd-43e854c31f15 req-b9409047-0256-4397-a71f-7218862cc817 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:18 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Took 1.76 seconds to deallocate network for instance.
Oct 20 13:10:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-63f94b63-08d0-485f-abdd-43e854c31f15 req-b9409047-0256-4397-a71f-7218862cc817 service nova] [instance: c01fac28-bf12-407e-a7a2-bc2a4ed68e1c] Detach interface failed, port_id=f6ce411f-c69c-476b-8018-78ed8fc2c90a, reason: Instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:19 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Deleted allocations for instance c01fac28-bf12-407e-a7a2-bc2a4ed68e1c
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8af2844d-ea90-4f31-b29c-90b4ea776d36 tempest-VolumesAssistedSnapshotsTest-703313000 tempest-VolumesAssistedSnapshotsTest-703313000-project-member] Lock "c01fac28-bf12-407e-a7a2-bc2a4ed68e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.314s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:19 user nova-compute[74701]: INFO nova.compute.manager [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Terminating instance
Oct 20 13:10:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-09650c14-bd84-48a9-9d5d-d6f1e4372398 req-73d309b2-10ab-4405-8959-c67798394e28 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-e8b7060d-22e1-4259-81f0-e1be95abc54b for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-de1655d6-9ab9-4f8c-950f-7f2082932f72 req-a9a97190-4192-418b-a69f-8237473bddd3 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-5ee9a45a-c431-47d6-849d-2313a7b27afd for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-a1328795-0748-42ec-a6f4-4e87389cb271 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:20 user nova-compute[74701]: WARNING nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-a1328795-0748-42ec-a6f4-4e87389cb271 for instance with vm_state active and task_state deleting.
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-70b00177-3569-4aa4-897b-0fc6a3ab30b3 req-eaa3e17c-d771-4132-b418-25818597a7df service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:21 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Instance destroyed successfully.
Oct 20 13:10:21 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lazy-loading 'resources' on Instance uuid 71b23879-5dfd-44df-b6ca-6abad87aefa3 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b7060d-22, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d33b156-68d4-4f4a-8a9f-fd6bd1da2c33) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:53,bridge_name='br-int',has_traffic_filtering=True,id=e8b7060d-22e1-4259-81f0-e1be95abc54b,network=Network(d4ad1411-22ed-4adf-aca4-60fee8e1eb7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b7060d-22')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1328795-07, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c0c406-7052-449e-87e6-9ffdeae777dd) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e8:d8,bridge_name='br-int',has_traffic_filtering=True,id=a1328795-0748-42ec-a6f4-4e87389cb271,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1328795-07')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ee9a45a-c4, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d252267-8607-499a-baf4-625e6f8b9528) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:05:15,bridge_name='br-int',has_traffic_filtering=True,id=5ee9a45a-c431-47d6-849d-2313a7b27afd,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ee9a45a-c4')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "address": "fa:16:3e:2d:b6:34", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14d71af-e9", "ovs_interfaceid": "d14d71af-e9c3-4c50-93af-9dae07eb843d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd14d71af-e9, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9407b1f-1b4a-49d9-801a-3c61bc38b29c) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=d14d71af-e9c3-4c50-93af-9dae07eb843d,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14d71af-e9')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d5bd3cf-c4, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0ef77ec-6a25-4a07-8b2f-3df7a9ef58d6) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013,network=Network(f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5bd3cf-c4')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c6ffd26-46, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f19fe70-1b34-48c4-95f4-b2c2357f03b5) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:20,bridge_name='br-int',has_traffic_filtering=True,id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6ffd26-46')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-793640575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-793640575',id=10,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBKi6MFGBDnUsgOP9t8erJEhcLFuwLb+p2sqEmMzdKYQ2ZvqvOX27qEMPF8RXHWF8102CTXcLkf+fPZnoQ7lb/3ZCclMVg1KnyxcOTQQXVj3GM7WPIoHfCLbOZTJlIjEQ==',key_name='tempest-keypair-29253065',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='313a39d5426941ec816042fe52a8e544',ramdisk_id='',reservation_id='r-pyy50t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-18514064',owner_user_name='tempest-TaggedBootDevicesTest-18514064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5e1413023154e23bd8a99fa5ab17836',uuid=71b23879-5dfd-44df-b6ca-6abad87aefa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converting VIF {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b35cd52-40, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee29861-b716-4ae3-859c-4e0ece61bb49) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:22 user nova-compute[74701]: INFO os_vif [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e2:f6,bridge_name='br-int',has_traffic_filtering=True,id=0b35cd52-4089-47c0-9042-1a5edee5913f,network=Network(00f683b4-e0ac-4dd0-9226-aba578a4cfba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35cd52-40')
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHwsFyWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6540de-ce58-4bb2-a0b7-d37d9304d7bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:22 user nova-compute[74701]: No targets found.
Oct 20 13:10:22 user nova-compute[74701]: iSNS:
Oct 20 13:10:22 user nova-compute[74701]: No targets found.
Oct 20 13:10:22 user nova-compute[74701]: STATIC:
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:10:22 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:22 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:22 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:22 user nova-compute[74701]: No targets found.
Oct 20 13:10:22 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:22 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:22 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1820798-7eeb-4b94-9503-5fe3e7428ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0294c3f-51bb-452a-b045-7385a359e881]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:10:22 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:22 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f87014b7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380'): ({'sdf'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Removing single pathed devices sdf {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-e8b7060d-22e1-4259-81f0-e1be95abc54b for instance with vm_state active and task_state deleting.
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-0b35cd52-4089-47c0-9042-1a5edee5913f for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING nova.compute.manager [req-b15daba8-9c38-4c46-9175-88fac0e40da1 req-d29904f7-d83a-4422-a3d5-915c14e3ddf6 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-0b35cd52-4089-47c0-9042-1a5edee5913f for instance with vm_state active and task_state deleting.
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8684909-47a1-44be-b9ee-52ff70bb11da]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4e7a4-3bfa-4804-87b9-06df5bfca41e]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Flushing IO for device /dev/sdf {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-5ee9a45a-c431-47d6-849d-2313a7b27afd for instance with vm_state active and task_state deleting.
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-d14d71af-e9c3-4c50-93af-9dae07eb843d for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-d14d71af-e9c3-4c50-93af-9dae07eb843d for instance with vm_state active and task_state deleting.
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-unplugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-unplugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:22 user nova-compute[74701]: WARNING nova.compute.manager [req-00536019-6009-4baa-8b4a-665b9483c3e9 req-dd6b6d16-67b4-40fc-b851-218ca835d9d1 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 for instance with vm_state active and task_state deleting.
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0f4dc-37a0-4399-b318-21da2f5299d3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1ea445-4ad0-49fc-9621-523ab8c6de3d]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbcfcfc-4247-48c8-ac50-170023e27197]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9db3fd-ad7b-47df-8c3a-f53cf7f48ed4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260]
Oct 20 13:10:22 user nova-compute[74701]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:22 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda19f5d-0905-4802-a806-545f25ab9380 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c97da0-4bd7-4881-a200-083f8109d9d0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== disconnect_volume: return (375ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUazujqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] Acquiring lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] No waiting events found dispatching network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:23 user nova-compute[74701]: WARNING nova.compute.manager [req-bb62094f-c236-4768-a08c-691776cd6329 req-b8ef327f-082a-4ee5-82e6-09c175eef2ce service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received unexpected event network-vif-plugged-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 for instance with vm_state active and task_state deleting.
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf7daf-895e-409f-9511-c7615e9c99cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]: iSNS:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]: STATIC:
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:23 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:23 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[91484ada-3490-4a65-8b74-caf5da8b2f94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[767a792a-8d21-4113-8c19-0cf01bef5d5f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e011cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c'): ({'sdg'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Removing single pathed devices sdg {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde90fe8-a45c-4149-a540-315916593425]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df45a3-e9d0-4e1a-8293-1b729994c979]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Flushing IO for device /dev/sdg {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ff3920-36a8-43ac-b085-5acef8ea172a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c44975-4e6e-40e5-aab4-7ad03266d08f]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] SCSI volumes sdg have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bf3ac6-6396-476e-b2b0-0df1089aea49]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b73aaa-3579-44d4-b736-7fd92de9dec3]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260]
Oct 20 13:10:23 user nova-compute[74701]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fb63a6-b752-4981-9def-1ed105e6593c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f979a86-9e86-471f-9488-5a837707dc09]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== disconnect_volume: return (318ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsutmynR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45d3f3e-8469-4efe-8e1a-263a49bdf404]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]: iSNS:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]: STATIC:
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:10:23 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:23 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:23 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:23 user nova-compute[74701]: No targets found.
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:23 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:23 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c82b07-4388-4f87-b060-6ef9001c357f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05535cd5-f82e-44e0-bfc2-96f55f4e7584]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 (non-flash)
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e011cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9'): ({'sdh'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Removing single pathed devices sdh {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe5c3c-3374-43e8-a2b9-8c0701fb4906]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80514e3-5044-483f-8da4-fbeea8d162e5]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Flushing IO for device /dev/sdh {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4424fcd-0211-4266-93ea-bd5e86e6a6c2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff4724-87fa-4b1e-a93a-a6b2b77a98f9]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] SCSI volumes sdh have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d7d5dc-b76e-4171-92d6-94d495a7f74c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848bdce-0b0f-4e8e-a922-70942ac070a0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260]
Oct 20 13:10:23 user nova-compute[74701]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f86708c-5e83-496a-bd06-b2281e0d2ab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4eff7e-4b8e-4b79-8abe-123bea153b1c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] <== disconnect_volume: return (317ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Deleting instance files /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3_del
Oct 20 13:10:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Deletion of /opt/stack/data/nova/instances/71b23879-5dfd-44df-b6ca-6abad87aefa3_del complete
Oct 20 13:10:23 user nova-compute[74701]: INFO nova.compute.manager [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Took 3.80 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:23 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:23 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-fea4c2b7-06d0-48a1-816b-338215bde6e3 req-dca1df89-8745-4494-b6fb-f4e9e5cbfb1e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-deleted-d14d71af-e9c3-4c50-93af-9dae07eb843d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:25 user nova-compute[74701]: INFO nova.compute.manager [req-fea4c2b7-06d0-48a1-816b-338215bde6e3 req-dca1df89-8745-4494-b6fb-f4e9e5cbfb1e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Neutron deleted interface d14d71af-e9c3-4c50-93af-9dae07eb843d; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-fea4c2b7-06d0-48a1-816b-338215bde6e3 req-dca1df89-8745-4494-b6fb-f4e9e5cbfb1e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "address": "fa:16:3e:a1:9a:a6", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5bd3cf-c4", "ovs_interfaceid": "7d5bd3cf-c4ee-463a-9c90-f51022ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-fea4c2b7-06d0-48a1-816b-338215bde6e3 req-dca1df89-8745-4494-b6fb-f4e9e5cbfb1e service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Detach interface failed, port_id=d14d71af-e9c3-4c50-93af-9dae07eb843d, reason: Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:26 user nova-compute[74701]: INFO nova.compute.manager [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Terminating instance
Oct 20 13:10:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Instance destroyed successfully.
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lazy-loading 'resources' on Instance uuid bdb0629d-0150-445c-b842-52a1c0ebbd41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538760454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538760454',id=7,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBqlnpjB/VcgOImilb6YNaMPZcV+P/t04Xvk0HlYz9NVEvkA95rq+JI3IiPMx/4IoTKHXQHCdxhMo+bhjSatkIup/Gl6rixkQC7jPIqumxLY+sHCa9uNbaF3UQb+QvqQ==',key_name='tempest-keypair-1485747717',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d7907705534cadabf146dd7de662d0',ramdisk_id='',reservation_id='r-inm157uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382218452',owner_user_name='tempest-TaggedAttachmentsTest-1382218452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3350fab957a47ea9f835198cbd20119',uuid=bdb0629d-0150-445c-b842-52a1c0ebbd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converting VIF {"id": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "address": "fa:16:3e:43:6c:95", "network": {"id": "08f426c0-d353-4b03-a081-b004a0158386", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1744650780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d7907705534cadabf146dd7de662d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bae838d-7e", "ovs_interfaceid": "5bae838d-7ebc-4362-bf9b-fd2b22dde080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG os_vif [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bae838d-7e, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a560757-f578-4b06-8ebc-ba61de76e66f) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:27 user nova-compute[74701]: INFO os_vif [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6c:95,bridge_name='br-int',has_traffic_filtering=True,id=5bae838d-7ebc-4362-bf9b-fd2b22dde080,network=Network(08f426c0-d353-4b03-a081-b004a0158386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bae838d-7e')
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Deleting instance files /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41_del
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Deletion of /opt/stack/data/nova/instances/bdb0629d-0150-445c-b842-52a1c0ebbd41_del complete
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.compute.manager [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-deleted-7d5bd3cf-c4ee-463a-9c90-f51022ff5013 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Neutron deleted interface 7d5bd3cf-c4ee-463a-9c90-f51022ff5013; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "address": "fa:16:3e:62:a5:53", "network": {"id": "d4ad1411-22ed-4adf-aca4-60fee8e1eb7a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-573821279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b7060d-22", "ovs_interfaceid": "e8b7060d-22e1-4259-81f0-e1be95abc54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Detach interface failed, port_id=7d5bd3cf-c4ee-463a-9c90-f51022ff5013, reason: Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-deleted-e8b7060d-22e1-4259-81f0-e1be95abc54b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Neutron deleted interface e8b7060d-22e1-4259-81f0-e1be95abc54b; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "address": "fa:16:3e:aa:8d:20", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6ffd26-46", "ovs_interfaceid": "2c6ffd26-46fa-48e4-8a9e-c992870b08a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Detach interface failed, port_id=e8b7060d-22e1-4259-81f0-e1be95abc54b, reason: Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-unplugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-unplugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-unplugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-deleted-2c6ffd26-46fa-48e4-8a9e-c992870b08a7 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Neutron deleted interface 2c6ffd26-46fa-48e4-8a9e-c992870b08a7; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [{"id": "a1328795-0748-42ec-a6f4-4e87389cb271", "address": "fa:16:3e:57:e8:d8", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1328795-07", "ovs_interfaceid": "a1328795-0748-42ec-a6f4-4e87389cb271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "address": "fa:16:3e:94:05:15", "network": {"id": "f3f8a862-1b4e-4fb0-af84-1f6a29c3e3eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1627635171", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ee9a45a-c4", "ovs_interfaceid": "5ee9a45a-c431-47d6-849d-2313a7b27afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b35cd52-4089-47c0-9042-1a5edee5913f", "address": "fa:16:3e:88:e2:f6", "network": {"id": "00f683b4-e0ac-4dd0-9226-aba578a4cfba", "bridge": "br-int", "label": "tempest-device-tagging-net2-2045832291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "313a39d5426941ec816042fe52a8e544", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35cd52-40", "ovs_interfaceid": "0b35cd52-4089-47c0-9042-1a5edee5913f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Detach interface failed, port_id=2c6ffd26-46fa-48e4-8a9e-c992870b08a7, reason: Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Acquiring lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] No waiting events found dispatching network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:27 user nova-compute[74701]: WARNING nova.compute.manager [req-99856a10-bbfd-4fc2-b837-d90313abf7b6 req-9cc29be3-2ff9-42a9-9ead-d38ad670405c service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received unexpected event network-vif-plugged-5bae838d-7ebc-4362-bf9b-fd2b22dde080 for instance with vm_state active and task_state deleting.
Oct 20 13:10:27 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:27 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Took 4.22 seconds to deallocate network for instance.
Oct 20 13:10:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:28 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Took 0.90 seconds to deallocate network for instance.
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-d2bde4c2-17e0-4e9a-8f90-b7e8b4b238ca req-5d1aa14e-f7b3-43b7-b007-36586b7801e7 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Received event network-vif-deleted-5bae838d-7ebc-4362-bf9b-fd2b22dde080 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:28 user nova-compute[74701]: INFO nova.compute.manager [req-d2bde4c2-17e0-4e9a-8f90-b7e8b4b238ca req-5d1aa14e-f7b3-43b7-b007-36586b7801e7 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Neutron deleted interface 5bae838d-7ebc-4362-bf9b-fd2b22dde080; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-d2bde4c2-17e0-4e9a-8f90-b7e8b4b238ca req-5d1aa14e-f7b3-43b7-b007-36586b7801e7 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-d2bde4c2-17e0-4e9a-8f90-b7e8b4b238ca req-5d1aa14e-f7b3-43b7-b007-36586b7801e7 service nova] [instance: bdb0629d-0150-445c-b842-52a1c0ebbd41] Detach interface failed, port_id=5bae838d-7ebc-4362-bf9b-fd2b22dde080, reason: Instance bdb0629d-0150-445c-b842-52a1c0ebbd41 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:28 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:29 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Deleted allocations for instance bdb0629d-0150-445c-b842-52a1c0ebbd41
Oct 20 13:10:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fe4ad2b4-0eb6-40a4-9075-57e20fb4a9d7 tempest-TaggedAttachmentsTest-1382218452 tempest-TaggedAttachmentsTest-1382218452-project-member] Lock "bdb0629d-0150-445c-b842-52a1c0ebbd41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.793s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-af2b64f8-409d-425d-b702-756da6c34b9e req-ab26a70b-3353-486a-9052-caad88c63653 service nova] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Received event network-vif-deleted-0b35cd52-4089-47c0-9042-1a5edee5913f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-changed-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing instance network info cache due to event network-changed-66432bbd-7941-4c6a-ab87-da0374b16c4c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] Acquiring lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] Acquired lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:31 user nova-compute[74701]: DEBUG nova.network.neutron [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Refreshing network info cache for port 66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:10:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updated VIF entry in instance network info cache for port 66432bbd-7941-4c6a-ab87-da0374b16c4c. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:10:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7eb4494f-cde0-4b3a-91e8-23a2a215239a req-44e4157b-1b4f-4862-a4c7-f3bbc2830929 service nova] Releasing lock "refresh_cache-f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:34 user nova-compute[74701]: INFO nova.compute.manager [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Terminating instance
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-7dad5bca-7585-400c-be00-8afbe8ca08c7 req-2958d109-09f4-4d39-83d2-ce679d079a74 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-66432bbd-7941-4c6a-ab87-da0374b16c4c for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-6dd45188-8984-40aa-b803-5db0bfe79459 req-93cbf2c4-3788-4079-9b39-ed603641fc24 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-d54532ea-fdfc-47b2-9125-f80a90a56046 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-6c6dc2b2-b8c2-46e4-83d5-f58dbdc0339d req-e62c25cd-b46d-4a6d-99bb-fae336e5213d service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Instance destroyed successfully.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lazy-loading 'resources' on Instance uuid f5b925b2-8341-4f1f-99d0-4a27ce9efe1f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66432bbd-79, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5a46384-abd8-486a-a093-18688e16e7d1) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:03:3b,bridge_name='br-int',has_traffic_filtering=True,id=66432bbd-7941-4c6a-ab87-da0374b16c4c,network=Network(8ed636c0-4495-4bb8-9a92-fb00f27d5f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66432bbd-79')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8660bbaa-5d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64cab667-eeff-406e-a003-f09933d18f4e) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=8660bbaa-5d3d-497e-8f78-b82dfe70c6bd,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8660bbaa-5d')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd54532ea-fd, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5bdea41-c7c5-4f95-b5d6-a6e752abc083) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:bc:91,bridge_name='br-int',has_traffic_filtering=True,id=d54532ea-fdfc-47b2-9125-f80a90a56046,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd54532ea-fd')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1166c4-57, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-66432bbd-7941-4c6a-ab87-da0374b16c4c for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-8660bbaa-5d3d-497e-8f78-b82dfe70c6bd for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ea1166c4-57e2-4f09-acf1-4e026c0a847f for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-b503c659-a651-41a0-bed4-592c91f6bea9 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-ab63824e-c6f1-4d78-b93b-1db4a0fb641c req-f573ac31-81a5-4683-8575-ae6445c5b827 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-b503c659-a651-41a0-bed4-592c91f6bea9 for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80e6ab45-c01f-43f2-a229-cb9893c075d0) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:43:23,bridge_name='br-int',has_traffic_filtering=True,id=ea1166c4-57e2-4f09-acf1-4e026c0a847f,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1166c4-57')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb503c659-a6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d07a022-4e4e-4f75-b227-691cb3111688) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:7c,bridge_name='br-int',has_traffic_filtering=True,id=b503c659-a651-41a0-bed4-592c91f6bea9,network=Network(12adac2f-e2a5-48f7-bff6-55de1cbfbdb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb503c659-a6')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "address": "fa:16:3e:d5:32:2d", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad025839-f8", "ovs_interfaceid": "ad025839-f8cd-41da-9ac8-4014d6e6e408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad025839-f8, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce9bd9bc-b4ff-460b-91fa-8320fa70249b) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:2d,bridge_name='br-int',has_traffic_filtering=True,id=ad025839-f8cd-41da-9ac8-4014d6e6e408,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad025839-f8')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T13:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630007420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630007420',id=11,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDweXh1yaB/D4F/8TDEYaLvI0mfA9eYOv21oxZpjyB4HTXZPVl6iRHKXCAspHrcsxACHEpyjxNkmxENjV2DUlNykrjdM9uDsh8+DNtXENrHMMjEKuII5vq8byCqDV4fvzg==',key_name='tempest-keypair-502259895',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d210ff985ac9417ebd810027ce595cff',ramdisk_id='',reservation_id='r-mu70guv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811732526',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811732526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81217338ece64953b1869c69ba9fe8c1',uuid=f5b925b2-8341-4f1f-99d0-4a27ce9efe1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converting VIF {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1234d8f-4a, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2259c6ba-7564-44bc-9156-5c5532a518a1) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:36 user nova-compute[74701]: INFO os_vif [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=a1234d8f-4aef-4b5d-9d45-df89de104b96,network=Network(d6626f95-e4ee-4879-b880-38f81166564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1234d8f-4a')
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqzRlgKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e66dd3-27a9-4b41-8f20-6ae05442fd04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:36 user nova-compute[74701]: No targets found.
Oct 20 13:10:36 user nova-compute[74701]: iSNS:
Oct 20 13:10:36 user nova-compute[74701]: No targets found.
Oct 20 13:10:36 user nova-compute[74701]: STATIC:
Oct 20 13:10:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:10:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668
Oct 20 13:10:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:36 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:36 user nova-compute[74701]: No targets found.
Oct 20 13:10:36 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:36 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:36 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[37091b7e-e8bb-4948-8925-981e6b06aef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d021179-a084-496b-b1e9-c37f82b36db0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:36 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0105000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668'): ({'sdj'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Removing single pathed devices sdj {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[027df809-2500-4981-b2e7-4ae36479fe84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7f039-dcd5-48f7-b13e-ec2d0e11f4f1]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Flushing IO for device /dev/sdj {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc270afb-130f-4b34-b5b3-b632e126b988]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-d54532ea-fdfc-47b2-9125-f80a90a56046 for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-unplugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-unplugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:36 user nova-compute[74701]: WARNING nova.compute.manager [req-d0bdfb13-81d0-40fe-a626-fb725a3380cf req-fac576ae-6aba-4147-909d-73a72e895e87 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-ad025839-f8cd-41da-9ac8-4014d6e6e408 for instance with vm_state active and task_state deleting.
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711ec3b-9ebf-41e4-a43c-27b73ecf4f6a]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] SCSI volumes sdj have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbb01e-5f98-4f14-a1cf-1fee0f829bd7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a46933-8603-4af9-b0db-e4c37f26f7a1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260]
Oct 20 13:10:37 user nova-compute[74701]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572c85ea-c3b3-47dd-b54f-daf5f12c3668 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[998734c9-dc91-4b52-aa29-952aa9ae6047]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== disconnect_volume: return (376ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWEuaGHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:37 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe4af53-976e-4c61-a09d-a85393cbe71f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]: iSNS:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]: STATIC:
Oct 20 13:10:37 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:37 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:37 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:37 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:37 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:37 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:37 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b
Oct 20 13:10:37 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:37 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:37 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:37 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:37 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d1e43a-6e91-4e67-8b8d-b6a8bbf18d50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0435df-96e5-4b23-bea1-e1c55904259e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e018be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedb93b-8250-4eff-99db-1675982a6ef3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0161737-2297-4d59-8c76-c3a0634432a0]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae445c4a-33ae-4462-8b4b-2fdfc66df9eb]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e6eea-5d01-44e5-bac1-2893fca61ff3]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d447b-883a-4d09-9662-2c21b1e5ed7b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] Acquiring lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] No waiting events found dispatching network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:37 user nova-compute[74701]: WARNING nova.compute.manager [req-d122825b-cfff-49bf-ab6b-14620fefffaf req-6236e601-1f7c-4a90-bc74-f2fb6fb8edb7 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received unexpected event network-vif-plugged-a1234d8f-4aef-4b5d-9d45-df89de104b96 for instance with vm_state active and task_state deleting.
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d4e121-3237-487d-a852-149200be709c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260]
Oct 20 13:10:37 user nova-compute[74701]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed2534f-14af-4e54-8235-42393831134b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77282106-5da4-4bbf-91e7-d5e669eb8cbe]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== disconnect_volume: return (340ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdyRDzCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:37 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37e9f2b-3713-4104-a951-fe1ed7300b4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]: iSNS:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]: STATIC:
Oct 20 13:10:37 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86
Oct 20 13:10:37 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:37 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:37 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:10:37 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:10:37 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:10:37 user nova-compute[74701]: FIRMWARE:
Oct 20 13:10:37 user nova-compute[74701]: No targets found.
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:10:37 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:10:37 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f896ab-101d-4286-b7a4-e14f41130415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6517ca1-1dc3-4681-949e-c0a012be68f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e018be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86'): ({'sdl'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Removing single pathed devices sdl {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[89640a6d-8b17-47fa-90e4-3c9f3bb1d71a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e6e41-0350-46c9-bdf5-6dd99690f2be]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Flushing IO for device /dev/sdl {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb294b4-6d5a-42b0-b560-4d304c10b612]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.054s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c9f8ef-2a5d-415c-8345-c8bc4cce3aa8]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] SCSI volumes sdl have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f49bc8-8dc1-4f7b-aa76-a86371fb016f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95744be-c35c-4752-a836-e1a4fca31da8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260]
Oct 20 13:10:37 user nova-compute[74701]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f39f17b-884a-4717-acee-b137ca974d86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa837fc-e8d0-4c26-9054-32313e430c8f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] <== disconnect_volume: return (310ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:10:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Deleting instance files /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f_del
Oct 20 13:10:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Deletion of /opt/stack/data/nova/instances/f5b925b2-8341-4f1f-99d0-4a27ce9efe1f_del complete
Oct 20 13:10:37 user nova-compute[74701]: INFO nova.compute.manager [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Took 3.85 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:37 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:37 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-951d7b00-75e5-4732-9137-9913d1af17d0 req-5c3e198f-eb73-40be-ac77-bef932133385 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-deleted-ad025839-f8cd-41da-9ac8-4014d6e6e408 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:39 user nova-compute[74701]: INFO nova.compute.manager [req-951d7b00-75e5-4732-9137-9913d1af17d0 req-5c3e198f-eb73-40be-ac77-bef932133385 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Neutron deleted interface ad025839-f8cd-41da-9ac8-4014d6e6e408; detaching it from the instance and deleting it from the info cache
Oct 20 13:10:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-951d7b00-75e5-4732-9137-9913d1af17d0 req-5c3e198f-eb73-40be-ac77-bef932133385 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [{"id": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "address": "fa:16:3e:59:03:3b", "network": {"id": "8ed636c0-4495-4bb8-9a92-fb00f27d5f27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1319783042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66432bbd-79", "ovs_interfaceid": "66432bbd-7941-4c6a-ab87-da0374b16c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "address": "fa:16:3e:7b:55:4c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8660bbaa-5d", "ovs_interfaceid": "8660bbaa-5d3d-497e-8f78-b82dfe70c6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d54532ea-fdfc-47b2-9125-f80a90a56046", "address": "fa:16:3e:27:bc:91", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54532ea-fd", "ovs_interfaceid": "d54532ea-fdfc-47b2-9125-f80a90a56046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "address": "fa:16:3e:64:43:23", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1166c4-57", "ovs_interfaceid": "ea1166c4-57e2-4f09-acf1-4e026c0a847f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b503c659-a651-41a0-bed4-592c91f6bea9", "address": "fa:16:3e:e1:46:7c", "network": {"id": "12adac2f-e2a5-48f7-bff6-55de1cbfbdb6", "bridge": "br-int", "label": "tempest-device-tagging-net1-658082883", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb503c659-a6", "ovs_interfaceid": "b503c659-a651-41a0-bed4-592c91f6bea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "address": "fa:16:3e:22:7d:48", "network": {"id": "d6626f95-e4ee-4879-b880-38f81166564c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1072623834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d210ff985ac9417ebd810027ce595cff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1234d8f-4a", "ovs_interfaceid": "a1234d8f-4aef-4b5d-9d45-df89de104b96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-951d7b00-75e5-4732-9137-9913d1af17d0 req-5c3e198f-eb73-40be-ac77-bef932133385 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Detach interface failed, port_id=ad025839-f8cd-41da-9ac8-4014d6e6e408, reason: Instance f5b925b2-8341-4f1f-99d0-4a27ce9efe1f could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:41 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Took 3.29 seconds to deallocate network for instance.
Oct 20 13:10:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b75c6da-c902-4f68-aea4-38c14c884250 req-de130445-909f-496c-b340-e88c0c2c0070 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-deleted-a1234d8f-4aef-4b5d-9d45-df89de104b96 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b75c6da-c902-4f68-aea4-38c14c884250 req-de130445-909f-496c-b340-e88c0c2c0070 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-deleted-66432bbd-7941-4c6a-ab87-da0374b16c4c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b75c6da-c902-4f68-aea4-38c14c884250 req-de130445-909f-496c-b340-e88c0c2c0070 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-deleted-ea1166c4-57e2-4f09-acf1-4e026c0a847f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b75c6da-c902-4f68-aea4-38c14c884250 req-de130445-909f-496c-b340-e88c0c2c0070 service nova] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Received event network-vif-deleted-b503c659-a651-41a0-bed4-592c91f6bea9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-changed-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Refreshing instance network info cache due to event network-changed-26053974-4792-4e45-8439-aef9778cc5f3. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] Acquiring lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] Acquired lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Refreshing network info cache for port 26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updated VIF entry in instance network info cache for port 26053974-4792-4e45-8439-aef9778cc5f3. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updating instance_info_cache with network_info: [{"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dbe11fd7-5a14-4428-bd41-fc56173247d4 req-59a6630d-3530-4806-af6d-04bdc7bc9df0 service nova] Releasing lock "refresh_cache-304e7ddb-040e-4da7-8d52-1e183369827f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:10:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: INFO nova.compute.manager [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Rescuing
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:51 user nova-compute[74701]: INFO nova.compute.manager [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Terminating instance
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:10:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Creating image(s)
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Ensure instance console log exists: /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start _get_guest_xml network_info=[{"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd275ea5d-2ee8-4474-be60-57675370409f', 'attached_at': '', 'detached_at': '', 'volume_id': '8130bccf-b499-4013-a02e-294619154a38', 'serial': '8130bccf-b499-4013-a02e-294619154a38'}, 'attachment_id': '841ea60b-8982-4d71-b2da-2c8f14aa5451', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:10:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 13:10:51 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lazy-loading 'vcpu_model' on Instance uuid d275ea5d-2ee8-4474-be60-57675370409f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:10:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:10:51 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[983fa883-a493-48ec-91a5-9bbd253bc8b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:10:51 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b35591-bece-4c70-a668-2fc7a4c332d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38] added
Oct 20 13:10:51 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0461d20-fcbc-490d-9a7c-151287033e34]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b4334-0251-49a7-9023-77786f34b22d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYSPkqax {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYSPkqax" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e2edd-d561-4c89-8823-6d0a5c5d7f46]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYSPkqax'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad1f1e0-5691-420f-934d-360117381be9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d39225-65e7-4f61-a5f6-435b2b7b3250]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-unplugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] No waiting events found dispatching network-vif-unplugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-2c45d0af-c97c-4695-be89-00ff7f63867f req-7a458a8e-62e8-46c3-b490-bb5538afbd72 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-unplugged-26053974-4792-4e45-8439-aef9778cc5f3 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24b096-bc04-4801-8fdc-6b5a41468174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]
Oct 20 13:10:52 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.
Oct 20 13:10:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e606ea27-24d7-4da8-972e-62c35a480d98]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5990311c-c9cc-40f3-a2a6-25288b9fc5fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:10:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cf2858-df55-417f-8b86-ce5c71f3cd17]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Instance destroyed successfully.
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'resources' on Instance uuid 304e7ddb-040e-4da7-8d52-1e183369827f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947884722',display_name='tempest-AttachVolumeNegativeTest-server-1947884722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947884722',id=12,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPPWbJjDPb3MVGGJn023LmNmvlrUzAX6YIi/BWRL4bDc/CwedTV8Q3XWFgyqzs9JbJrZgfK46GkfFKGuKvXRb4SiFxedmwE1EF39Wq3QxwYVN03bMdzOGy2fqVXuXZdtw==',key_name='tempest-keypair-616765592',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-9p0mhx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=304e7ddb-040e-4da7-8d52-1e183369827f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "26053974-4792-4e45-8439-aef9778cc5f3", "address": "fa:16:3e:05:76:67", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26053974-47", "ovs_interfaceid": "26053974-4792-4e45-8439-aef9778cc5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG os_vif [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26053974-47, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b56507-6409-4e02-8e4a-2a3c8531f758) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: INFO os_vif [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:76:67,bridge_name='br-int',has_traffic_filtering=True,id=26053974-4792-4e45-8439-aef9778cc5f3,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26053974-47')
Oct 20 13:10:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Deleting instance files /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f_del
Oct 20 13:10:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Deletion of /opt/stack/data/nova/instances/304e7ddb-040e-4da7-8d52-1e183369827f_del complete
Oct 20 13:10:52 user nova-compute[74701]: INFO nova.compute.manager [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] [instance: f5b925b2-8341-4f1f-99d0-4a27ce9efe1f] Took 11.50 seconds to detach 3 volumes for instance.
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:52 user nova-compute[74701]: INFO nova.compute.manager [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:52 user nova-compute[74701]: WARNING nova.compute.manager [req-ee5033db-b1ba-470c-b560-c3133aac76ee req-94cace13-0f0f-4c42-a08a-8af924e764ef service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state rescuing.
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26631616163326366', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631616163326366', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance destroyed successfully.
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Attempting rescue
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74701) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1074964372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:07:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:10:53 user nova-compute[74701]:   <uuid>d275ea5d-2ee8-4474-be60-57675370409f</uuid>
Oct 20 13:10:53 user nova-compute[74701]:   <name>instance-00000009</name>
Oct 20 13:10:53 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:10:53 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:10:53 user nova-compute[74701]:   <metadata>
Oct 20 13:10:53 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:10:53 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:10:53 user nova-compute[74701]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1074964372</nova:name>
Oct 20 13:10:53 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:10:51</nova:creationTime>
Oct 20 13:10:53 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:10:53 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:10:53 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:10:53 user nova-compute[74701]:       <nova:owner>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:user uuid="0429fbfe8ec14007b53153f70294e75d">tempest-ServerActionsV293TestJSON-1180019451-project-member</nova:user>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:project uuid="f284b2af22754158b35ab6e7b8182fef">tempest-ServerActionsV293TestJSON-1180019451</nova:project>
Oct 20 13:10:53 user nova-compute[74701]:       </nova:owner>
Oct 20 13:10:53 user nova-compute[74701]:       <nova:ports>
Oct 20 13:10:53 user nova-compute[74701]:         <nova:port uuid="8e5d0654-5690-49ac-a149-0283de693b26">
Oct 20 13:10:53 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:10:53 user nova-compute[74701]:         </nova:port>
Oct 20 13:10:53 user nova-compute[74701]:       </nova:ports>
Oct 20 13:10:53 user nova-compute[74701]:     </nova:instance>
Oct 20 13:10:53 user nova-compute[74701]:   </metadata>
Oct 20 13:10:53 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:10:53 user nova-compute[74701]:     <system>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="serial">d275ea5d-2ee8-4474-be60-57675370409f</entry>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="uuid">d275ea5d-2ee8-4474-be60-57675370409f</entry>
Oct 20 13:10:53 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:10:53 user nova-compute[74701]:     </system>
Oct 20 13:10:53 user nova-compute[74701]:   </sysinfo>
Oct 20 13:10:53 user nova-compute[74701]:   <os>
Oct 20 13:10:53 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:10:53 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:10:53 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:10:53 user nova-compute[74701]:   </os>
Oct 20 13:10:53 user nova-compute[74701]:   <features>
Oct 20 13:10:53 user nova-compute[74701]:     <acpi/>
Oct 20 13:10:53 user nova-compute[74701]:     <apic/>
Oct 20 13:10:53 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:10:53 user nova-compute[74701]:   </features>
Oct 20 13:10:53 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:10:53 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:10:53 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:10:53 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:10:53 user nova-compute[74701]:   </clock>
Oct 20 13:10:53 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:10:53 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:10:53 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:10:53 user nova-compute[74701]:   </cpu>
Oct 20 13:10:53 user nova-compute[74701]:   <devices>
Oct 20 13:10:53 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:10:53 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:10:53 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:10:53 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:10:53 user nova-compute[74701]:       <serial>8130bccf-b499-4013-a02e-294619154a38</serial>
Oct 20 13:10:53 user nova-compute[74701]:     </disk>
Oct 20 13:10:53 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:10:53 user nova-compute[74701]:       <mac address="fa:16:3e:2d:d9:6a"/>
Oct 20 13:10:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:53 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:10:53 user nova-compute[74701]:       <target dev="tap8e5d0654-56"/>
Oct 20 13:10:53 user nova-compute[74701]:     </interface>
Oct 20 13:10:53 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:10:53 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f/console.log" append="off"/>
Oct 20 13:10:53 user nova-compute[74701]:     </serial>
Oct 20 13:10:53 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:10:53 user nova-compute[74701]:     <video>
Oct 20 13:10:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:53 user nova-compute[74701]:     </video>
Oct 20 13:10:53 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:10:53 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:10:53 user nova-compute[74701]:     </rng>
Oct 20 13:10:53 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:10:53 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:10:53 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:10:53 user nova-compute[74701]:     </memballoon>
Oct 20 13:10:53 user nova-compute[74701]:   </devices>
Oct 20 13:10:53 user nova-compute[74701]: </domain>
Oct 20 13:10:53 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1074964372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:07:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG os_vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ab0ecef-266e-599b-9e7f-9ef69cebbc61', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:10:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Creating image(s)
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e5d0654-56, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e5d0654-56, col_values=(('qos', UUID('5f8c63f0-5fca-41ad-b94a-522c8b6b8180')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e5d0654-56, col_values=(('external_ids', {'iface-id': '8e5d0654-5690-49ac-a149-0283de693b26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:d9:6a', 'vm-uuid': 'd275ea5d-2ee8-4474-be60-57675370409f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:53 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Deleted allocations for instance f5b925b2-8341-4f1f-99d0-4a27ce9efe1f
Oct 20 13:10:53 user nova-compute[74701]: INFO os_vif [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56')
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] No VIF found with MAC fa:16:3e:2d:d9:6a, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dde973b-f368-485f-aa73-c0f9d985b270 tempest-TaggedBootDevicesTest_v242-1811732526 tempest-TaggedBootDevicesTest_v242-1811732526-project-member] Lock "f5b925b2-8341-4f1f-99d0-4a27ce9efe1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.747s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue" returned: 0 in 0.061s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'migration_context' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start _get_guest_xml network_info=[{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:12:41:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'numa_topology' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:10:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-27796603',display_name='tempest-ServerRescueNegativeTestJSON-server-27796603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-27796603',id=2,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-q76r6k3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:06:20Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:12:41:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:10:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:12:41:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.objects.base [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:10:54 user nova-compute[74701]:   <uuid>d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</uuid>
Oct 20 13:10:54 user nova-compute[74701]:   <name>instance-00000002</name>
Oct 20 13:10:54 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:10:54 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:10:54 user nova-compute[74701]:   <metadata>
Oct 20 13:10:54 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:10:54 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-27796603</nova:name>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:10:53</nova:creationTime>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:10:54 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:10:54 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:owner>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:10:54 user nova-compute[74701]:       </nova:owner>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:10:54 user nova-compute[74701]:       <nova:ports>
Oct 20 13:10:54 user nova-compute[74701]:         <nova:port uuid="84ab858b-9317-44ab-bb71-12ee8268501b">
Oct 20 13:10:54 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 13:10:54 user nova-compute[74701]:         </nova:port>
Oct 20 13:10:54 user nova-compute[74701]:       </nova:ports>
Oct 20 13:10:54 user nova-compute[74701]:     </nova:instance>
Oct 20 13:10:54 user nova-compute[74701]:   </metadata>
Oct 20 13:10:54 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:10:54 user nova-compute[74701]:     <system>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="serial">d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</entry>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="uuid">d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2</entry>
Oct 20 13:10:54 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:10:54 user nova-compute[74701]:     </system>
Oct 20 13:10:54 user nova-compute[74701]:   </sysinfo>
Oct 20 13:10:54 user nova-compute[74701]:   <os>
Oct 20 13:10:54 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:10:54 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:10:54 user nova-compute[74701]:   </os>
Oct 20 13:10:54 user nova-compute[74701]:   <features>
Oct 20 13:10:54 user nova-compute[74701]:     <acpi/>
Oct 20 13:10:54 user nova-compute[74701]:     <apic/>
Oct 20 13:10:54 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:10:54 user nova-compute[74701]:   </features>
Oct 20 13:10:54 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:10:54 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:10:54 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:10:54 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:10:54 user nova-compute[74701]:   </clock>
Oct 20 13:10:54 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:10:54 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:10:54 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:10:54 user nova-compute[74701]:   </cpu>
Oct 20 13:10:54 user nova-compute[74701]:   <devices>
Oct 20 13:10:54 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:10:54 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:10:54 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue"/>
Oct 20 13:10:54 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:10:54 user nova-compute[74701]:     </disk>
Oct 20 13:10:54 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:10:54 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:10:54 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk"/>
Oct 20 13:10:54 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:10:54 user nova-compute[74701]:     </disk>
Oct 20 13:10:54 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:10:54 user nova-compute[74701]:       <mac address="fa:16:3e:12:41:2d"/>
Oct 20 13:10:54 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:54 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:10:54 user nova-compute[74701]:       <target dev="tap84ab858b-93"/>
Oct 20 13:10:54 user nova-compute[74701]:     </interface>
Oct 20 13:10:54 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:10:54 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/console.log" append="off"/>
Oct 20 13:10:54 user nova-compute[74701]:     </serial>
Oct 20 13:10:54 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:10:54 user nova-compute[74701]:     <video>
Oct 20 13:10:54 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:10:54 user nova-compute[74701]:     </video>
Oct 20 13:10:54 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:10:54 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:10:54 user nova-compute[74701]:     </rng>
Oct 20 13:10:54 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:10:54 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:10:54 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:10:54 user nova-compute[74701]:     </memballoon>
Oct 20 13:10:54 user nova-compute[74701]:   </devices>
Oct 20 13:10:54 user nova-compute[74701]: </domain>
Oct 20 13:10:54 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:10:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance destroyed successfully.
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:54 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Took 1.39 seconds to deallocate network for instance.
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] Acquiring lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] Lock "304e7ddb-040e-4da7-8d52-1e183369827f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] No waiting events found dispatching network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:54 user nova-compute[74701]: WARNING nova.compute.manager [req-9c250eda-b119-41bf-8ee1-5f3c14717045 req-b53ce151-9f2f-430b-bea5-3d646e9cf9db service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received unexpected event network-vif-plugged-26053974-4792-4e45-8439-aef9778cc5f3 for instance with vm_state active and task_state deleting.
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:12:41:2d, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:10:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '304e7ddb-040e-4da7-8d52-1e183369827f' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '304e7ddb-040e-4da7-8d52-1e183369827f' (instance-0000000c)
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:54 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:10:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=25.370826721191406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:10:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:55 user nova-compute[74701]: WARNING nova.compute.manager [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state rescuing.
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-df53b4b4-1ec7-4f9a-8c98-72519ac294a3 req-14aafae1-82fb-4c1f-a8bf-61788bbb1e19 service nova] [instance: 304e7ddb-040e-4da7-8d52-1e183369827f] Received event network-vif-deleted-26053974-4792-4e45-8439-aef9778cc5f3 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.369s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:55 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Deleted allocations for instance 304e7ddb-040e-4da7-8d52-1e183369827f
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 71b23879-5dfd-44df-b6ca-6abad87aefa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance cc61b092-3ef4-4b20-b02e-c8bb16586306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-12c3abd9-3fa4-4c8c-848c-f42a129f03f6 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "304e7ddb-040e-4da7-8d52-1e183369827f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.691s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:10:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:56 user nova-compute[74701]: WARNING nova.compute.manager [req-aef5f702-ff1f-47e2-bfb5-41bf2703f14e req-045384f7-5ee3-43c1-9272-b723eefeae31 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:57 user nova-compute[74701]: WARNING nova.compute.manager [req-855cfe66-ccf8-468b-9372-728e759ab17d req-8bb62a42-c140-4294-b438-7c18492cf6ad service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state rescuing.
Oct 20 13:10:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [{"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-b8dbbea7-4330-4bdd-adea-7b28bfca9726" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:10:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:10:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:58 user nova-compute[74701]: WARNING nova.compute.manager [req-55c36c41-b95b-403b-ad31-49e6e5b5a056 req-53df1f31-262d-4fda-9b08-798fdc075238 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 13:10:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:10:59 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance spawned successfully.
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-38d6be96-a43c-4982-9b9c-2540dad27332 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:10:59 user nova-compute[74701]: WARNING nova.compute.manager [req-193ef195-5be2-481d-a839-45e691f91c69 req-b3eaf30b-a61a-483f-a0e1-83797a8ab3e3 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state active and task_state rescuing.
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74701) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 13:10:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8cebb8a5-88ac-40a3-a070-5d761d7673ea tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:12 user nova-compute[74701]: INFO nova.compute.manager [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] [instance: 71b23879-5dfd-44df-b6ca-6abad87aefa3] Took 44.61 seconds to detach 3 volumes for instance.
Oct 20 13:11:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:11:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:11:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:13 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Deleted allocations for instance 71b23879-5dfd-44df-b6ca-6abad87aefa3
Oct 20 13:11:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f696f605-7ef5-4322-b801-5776ff5954f8 tempest-TaggedBootDevicesTest-18514064 tempest-TaggedBootDevicesTest-18514064-project-member] Lock "71b23879-5dfd-44df-b6ca-6abad87aefa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 53.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:11:35 user nova-compute[74701]: INFO nova.compute.claims [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Claim successful on node user
Oct 20 13:11:35 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:11:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.policy [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '751a8755f9774b1da2e71623164c40b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed52bceb45147ceb782e49acf3a9d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:11:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Creating image(s)
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "/opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.223s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk 1073741824" returned: 0 in 0.102s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Successfully created port: 9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Cannot resize image /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Ensure instance console log exists: /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Successfully updated port: 9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:11:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-changed-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Refreshing instance network info cache due to event network-changed-9072d2f8-7091-470b-b00a-23eba08d6eb9. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Instance network_info: |[{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Refreshing network info cache for port 9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Start _get_guest_xml network_info=[{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:11:38 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:38 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-287900680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-287900680',id=14,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-kkfip6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:11:36Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=1458c67f-2bbe-45d9-9c33-130b83f58dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:11:38 user nova-compute[74701]:   <uuid>1458c67f-2bbe-45d9-9c33-130b83f58dfd</uuid>
Oct 20 13:11:38 user nova-compute[74701]:   <name>instance-0000000e</name>
Oct 20 13:11:38 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:11:38 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:11:38 user nova-compute[74701]:   <metadata>
Oct 20 13:11:38 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:11:38 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-287900680</nova:name>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:11:38</nova:creationTime>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:11:38 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:11:38 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:owner>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:11:38 user nova-compute[74701]:       </nova:owner>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:11:38 user nova-compute[74701]:       <nova:ports>
Oct 20 13:11:38 user nova-compute[74701]:         <nova:port uuid="9072d2f8-7091-470b-b00a-23eba08d6eb9">
Oct 20 13:11:38 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:11:38 user nova-compute[74701]:         </nova:port>
Oct 20 13:11:38 user nova-compute[74701]:       </nova:ports>
Oct 20 13:11:38 user nova-compute[74701]:     </nova:instance>
Oct 20 13:11:38 user nova-compute[74701]:   </metadata>
Oct 20 13:11:38 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:11:38 user nova-compute[74701]:     <system>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="serial">1458c67f-2bbe-45d9-9c33-130b83f58dfd</entry>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="uuid">1458c67f-2bbe-45d9-9c33-130b83f58dfd</entry>
Oct 20 13:11:38 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:11:38 user nova-compute[74701]:     </system>
Oct 20 13:11:38 user nova-compute[74701]:   </sysinfo>
Oct 20 13:11:38 user nova-compute[74701]:   <os>
Oct 20 13:11:38 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:11:38 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:11:38 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:11:38 user nova-compute[74701]:   </os>
Oct 20 13:11:38 user nova-compute[74701]:   <features>
Oct 20 13:11:38 user nova-compute[74701]:     <acpi/>
Oct 20 13:11:38 user nova-compute[74701]:     <apic/>
Oct 20 13:11:38 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:11:38 user nova-compute[74701]:   </features>
Oct 20 13:11:38 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:11:38 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:11:38 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:11:38 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:11:38 user nova-compute[74701]:   </clock>
Oct 20 13:11:38 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:11:38 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:11:38 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:11:38 user nova-compute[74701]:   </cpu>
Oct 20 13:11:38 user nova-compute[74701]:   <devices>
Oct 20 13:11:38 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:11:38 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:11:38 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk"/>
Oct 20 13:11:38 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:11:38 user nova-compute[74701]:     </disk>
Oct 20 13:11:38 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:11:38 user nova-compute[74701]:       <mac address="fa:16:3e:c6:29:2a"/>
Oct 20 13:11:38 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:11:38 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:11:38 user nova-compute[74701]:       <target dev="tap9072d2f8-70"/>
Oct 20 13:11:38 user nova-compute[74701]:     </interface>
Oct 20 13:11:38 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:11:38 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/console.log" append="off"/>
Oct 20 13:11:38 user nova-compute[74701]:     </serial>
Oct 20 13:11:38 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:11:38 user nova-compute[74701]:     <video>
Oct 20 13:11:38 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:11:38 user nova-compute[74701]:     </video>
Oct 20 13:11:38 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:11:38 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:11:38 user nova-compute[74701]:     </rng>
Oct 20 13:11:38 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:11:38 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:11:38 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:11:38 user nova-compute[74701]:     </memballoon>
Oct 20 13:11:38 user nova-compute[74701]:   </devices>
Oct 20 13:11:38 user nova-compute[74701]: </domain>
Oct 20 13:11:38 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-287900680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-287900680',id=14,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-kkfip6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:11:36Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=1458c67f-2bbe-45d9-9c33-130b83f58dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG os_vif [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5319451-ea00-5dff-a3ae-d119bd16dba0', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9072d2f8-70, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9072d2f8-70, col_values=(('qos', UUID('2e054e8d-9589-4b61-84b8-21f831c7a8d3')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9072d2f8-70, col_values=(('external_ids', {'iface-id': '9072d2f8-7091-470b-b00a-23eba08d6eb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:29:2a', 'vm-uuid': '1458c67f-2bbe-45d9-9c33-130b83f58dfd'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:38 user nova-compute[74701]: INFO os_vif [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70')
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:c6:29:2a, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updated VIF entry in instance network info cache for port 9072d2f8-7091-470b-b00a-23eba08d6eb9. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:11:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6379bb20-15a6-424d-8e64-50c7968fa2c4 req-dc067c46-8ab5-40f9-92fb-969404a7f5ae service nova] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:11:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] No waiting events found dispatching network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:11:40 user nova-compute[74701]: WARNING nova.compute.manager [req-a1d6ee11-a5ce-4839-bf9c-9650d2a38c2a req-0a81a98b-ef30-450a-be80-b30650f9f777 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received unexpected event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 for instance with vm_state building and task_state spawning.
Oct 20 13:11:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:11:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Instance spawned successfully.
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] No waiting events found dispatching network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:11:42 user nova-compute[74701]: WARNING nova.compute.manager [req-feb3f988-5735-4dae-925b-16affd46c2f8 req-3a9eb202-e426-487a-bc4e-f2f5600f6062 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received unexpected event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 for instance with vm_state building and task_state spawning.
Oct 20 13:11:42 user nova-compute[74701]: INFO nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 20 13:11:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:11:42 user nova-compute[74701]: INFO nova.compute.manager [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Took 7.06 seconds to build instance.
Oct 20 13:11:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6e67754a-460c-4156-8729-ed5f5df91fd4 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.192s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:43 user nova-compute[74701]: INFO nova.compute.manager [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Detaching volume 00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:11:43 user nova-compute[74701]: INFO nova.virt.block_device [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Attempting to driver detach volume 00b5ee96-5d84-4886-8059-3df43a5bfab5 from mountpoint /dev/vdb
Oct 20 13:11:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Attempting to detach device vdb from instance d8e28db3-6b19-459f-b314-09ede99f9c8d from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:11:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:11:43 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:11:43 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:11:43 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:11:43 user nova-compute[74701]:   <serial>00b5ee96-5d84-4886-8059-3df43a5bfab5</serial>
Oct 20 13:11:43 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:11:43 user nova-compute[74701]: </disk>
Oct 20 13:11:43 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:11:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance d8e28db3-6b19-459f-b314-09ede99f9c8d from the persistent domain config.
Oct 20 13:11:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8e28db3-6b19-459f-b314-09ede99f9c8d from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:11:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:11:43 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:11:43 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:11:43 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:11:43 user nova-compute[74701]:   <serial>00b5ee96-5d84-4886-8059-3df43a5bfab5</serial>
Oct 20 13:11:43 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:11:43 user nova-compute[74701]: </disk>
Oct 20 13:11:43 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:11:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:11:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:11:47 user nova-compute[74701]: INFO nova.compute.claims [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Claim successful on node user
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:11:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.policy [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055ddddbedde4ecfb7db9c52a8f415ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95261e7276ff4097ab6d975482f9e803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:11:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Creating image(s)
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "/opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "/opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "/opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.222s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk 1073741824" returned: 0 in 0.066s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Successfully created port: 41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Cannot resize image /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Ensure instance console log exists: /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Successfully updated port: 41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquired lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-changed-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Refreshing instance network info cache due to event network-changed-41f10cfb-5dbc-44f7-989c-3d550aef436c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] Acquiring lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:11:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.neutron [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updating instance_info_cache with network_info: [{"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Releasing lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Instance network_info: |[{"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] Acquired lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Refreshing network info cache for port 41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Start _get_guest_xml network_info=[{"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:11:50 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:50 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2036508820',display_name='tempest-TestVolumeSwap-server-2036508820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2036508820',id=15,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EjFDWuJ4jtrOpG7HIJoqUbupHJG9a0sJ/lzXLhd+NWBCiO3G4U9UcMaMgWE1Adg91FeuC1plzMr99H1VWdVpjk6sM42L+VelPe0t5saPoI53LV7rPWtKVq7S1nNsslA==',key_name='tempest-keypair-1828142458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95261e7276ff4097ab6d975482f9e803',ramdisk_id='',reservation_id='r-lv164sdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-904718920',owner_user_name='tempest-TestVolumeSwap-904718920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055ddddbedde4ecfb7db9c52a8f415ce',uuid=49cd00ef-639e-45d4-8681-4076ce232be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converting VIF {"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lazy-loading 'pci_devices' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:11:50 user nova-compute[74701]:   <uuid>49cd00ef-639e-45d4-8681-4076ce232be8</uuid>
Oct 20 13:11:50 user nova-compute[74701]:   <name>instance-0000000f</name>
Oct 20 13:11:50 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:11:50 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:11:50 user nova-compute[74701]:   <metadata>
Oct 20 13:11:50 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:11:50 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:name>tempest-TestVolumeSwap-server-2036508820</nova:name>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:11:50</nova:creationTime>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:11:50 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:11:50 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:owner>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:user uuid="055ddddbedde4ecfb7db9c52a8f415ce">tempest-TestVolumeSwap-904718920-project-member</nova:user>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:project uuid="95261e7276ff4097ab6d975482f9e803">tempest-TestVolumeSwap-904718920</nova:project>
Oct 20 13:11:50 user nova-compute[74701]:       </nova:owner>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:11:50 user nova-compute[74701]:       <nova:ports>
Oct 20 13:11:50 user nova-compute[74701]:         <nova:port uuid="41f10cfb-5dbc-44f7-989c-3d550aef436c">
Oct 20 13:11:50 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:11:50 user nova-compute[74701]:         </nova:port>
Oct 20 13:11:50 user nova-compute[74701]:       </nova:ports>
Oct 20 13:11:50 user nova-compute[74701]:     </nova:instance>
Oct 20 13:11:50 user nova-compute[74701]:   </metadata>
Oct 20 13:11:50 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:11:50 user nova-compute[74701]:     <system>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="serial">49cd00ef-639e-45d4-8681-4076ce232be8</entry>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="uuid">49cd00ef-639e-45d4-8681-4076ce232be8</entry>
Oct 20 13:11:50 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:11:50 user nova-compute[74701]:     </system>
Oct 20 13:11:50 user nova-compute[74701]:   </sysinfo>
Oct 20 13:11:50 user nova-compute[74701]:   <os>
Oct 20 13:11:50 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:11:50 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:11:50 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:11:50 user nova-compute[74701]:   </os>
Oct 20 13:11:50 user nova-compute[74701]:   <features>
Oct 20 13:11:50 user nova-compute[74701]:     <acpi/>
Oct 20 13:11:50 user nova-compute[74701]:     <apic/>
Oct 20 13:11:50 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:11:50 user nova-compute[74701]:   </features>
Oct 20 13:11:50 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:11:50 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:11:50 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:11:50 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:11:50 user nova-compute[74701]:   </clock>
Oct 20 13:11:50 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:11:50 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:11:50 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:11:50 user nova-compute[74701]:   </cpu>
Oct 20 13:11:50 user nova-compute[74701]:   <devices>
Oct 20 13:11:50 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:11:50 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:11:50 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk"/>
Oct 20 13:11:50 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:11:50 user nova-compute[74701]:     </disk>
Oct 20 13:11:50 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:11:50 user nova-compute[74701]:       <mac address="fa:16:3e:fb:87:0f"/>
Oct 20 13:11:50 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:11:50 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:11:50 user nova-compute[74701]:       <target dev="tap41f10cfb-5d"/>
Oct 20 13:11:50 user nova-compute[74701]:     </interface>
Oct 20 13:11:50 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:11:50 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/console.log" append="off"/>
Oct 20 13:11:50 user nova-compute[74701]:     </serial>
Oct 20 13:11:50 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:11:50 user nova-compute[74701]:     <video>
Oct 20 13:11:50 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:11:50 user nova-compute[74701]:     </video>
Oct 20 13:11:50 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:11:50 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:11:50 user nova-compute[74701]:     </rng>
Oct 20 13:11:50 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:11:50 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:11:50 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:11:50 user nova-compute[74701]:     </memballoon>
Oct 20 13:11:50 user nova-compute[74701]:   </devices>
Oct 20 13:11:50 user nova-compute[74701]: </domain>
Oct 20 13:11:50 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2036508820',display_name='tempest-TestVolumeSwap-server-2036508820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2036508820',id=15,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EjFDWuJ4jtrOpG7HIJoqUbupHJG9a0sJ/lzXLhd+NWBCiO3G4U9UcMaMgWE1Adg91FeuC1plzMr99H1VWdVpjk6sM42L+VelPe0t5saPoI53LV7rPWtKVq7S1nNsslA==',key_name='tempest-keypair-1828142458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95261e7276ff4097ab6d975482f9e803',ramdisk_id='',reservation_id='r-lv164sdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-904718920',owner_user_name='tempest-TestVolumeSwap-904718920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055ddddbedde4ecfb7db9c52a8f415ce',uuid=49cd00ef-639e-45d4-8681-4076ce232be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converting VIF {"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG os_vif [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72d965dc-90db-5825-ab6e-051de35ad428', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41f10cfb-5d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41f10cfb-5d, col_values=(('qos', UUID('3fbbbee1-d049-45fd-aac5-51c12510a50b')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41f10cfb-5d, col_values=(('external_ids', {'iface-id': '41f10cfb-5dbc-44f7-989c-3d550aef436c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:87:0f', 'vm-uuid': '49cd00ef-639e-45d4-8681-4076ce232be8'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:11:50 user nova-compute[74701]: INFO os_vif [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d')
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] No VIF found with MAC fa:16:3e:fb:87:0f, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updated VIF entry in instance network info cache for port 41f10cfb-5dbc-44f7-989c-3d550aef436c. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updating instance_info_cache with network_info: [{"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-777c7a52-5306-4ad2-8936-ecd2b63df87e req-ac84c3c0-2a15-49eb-a941-445551fd1e46 service nova] Releasing lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:50 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:11:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] No waiting events found dispatching network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:11:52 user nova-compute[74701]: WARNING nova.compute.manager [req-dba1a13b-a0ec-4408-a38e-c3c48e8a141e req-5402ac20-ed06-4ff6-90c1-619fd30769a4 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received unexpected event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c for instance with vm_state building and task_state spawning.
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] No waiting events found dispatching network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:11:54 user nova-compute[74701]: WARNING nova.compute.manager [req-4666d170-6864-46bf-8d55-fdbe3be2418d req-c1348ec1-19a7-41f5-861e-187b06b8ff79 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received unexpected event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c for instance with vm_state building and task_state spawning.
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:11:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Instance spawned successfully.
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:11:54 user nova-compute[74701]: INFO nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 20 13:11:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:54 user nova-compute[74701]: INFO nova.compute.manager [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Took 7.18 seconds to build instance.
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-243ebc14-1070-4a4a-943b-aeb0d6f6969f tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.328s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:11:57 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:57 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:11:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.372745513916016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:11:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d8e28db3-6b19-459f-b314-09ede99f9c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance cc61b092-3ef4-4b20-b02e-c8bb16586306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 49cd00ef-639e-45d4-8681-4076ce232be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:11:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8e28db3-6b19-459f-b314-09ede99f9c8d is timed out.
Oct 20 13:12:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance d8e28db3-6b19-459f-b314-09ede99f9c8d from the live domain config.
Oct 20 13:12:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeHBUown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:12:04 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbcb3d2-19d2-445f-bfa1-bf9b77bc09f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:12:04 user nova-compute[74701]: No targets found.
Oct 20 13:12:04 user nova-compute[74701]: iSNS:
Oct 20 13:12:04 user nova-compute[74701]: No targets found.
Oct 20 13:12:04 user nova-compute[74701]: STATIC:
Oct 20 13:12:04 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38
Oct 20 13:12:04 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:12:04 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:12:04 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5
Oct 20 13:12:04 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:12:04 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:12:04 user nova-compute[74701]: FIRMWARE:
Oct 20 13:12:04 user nova-compute[74701]: No targets found.
Oct 20 13:12:04 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:12:04 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:12:04 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6983f89-5de5-404f-80e0-de28b395c8e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e17f4-e9f8-485c-b651-3d72668745e5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:12:04 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:12:04 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:12:04 user nova-compute[74701]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 (non-flash)
Oct 20 13:12:04 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e01784c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0faa9-e241-4fce-8f6d-e70b6d230926]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29d97ff-995e-49d1-965f-ddb40015febc]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62eb9d-6df2-4b23-b749-b781c1cb3af1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d6ee10-fa32-4d48-84e5-6008db273b82]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2093e-c429-4b95-9692-ef15d1cfcb41]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3c8edd-dcc4-499a-8f3e-f7dac7ff6043]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260]
Oct 20 13:12:04 user nova-compute[74701]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5, portal: 172.16.0.220,3260] successful.
Oct 20 13:12:04 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b5ee96-5d84-4886-8059-3df43a5bfab5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e3093-bfb0-4729-9a96-16353d5cb1e5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== disconnect_volume: return (399ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:12:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:12:05 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6ec611c-d1d0-4695-955b-10a801c20371 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:09 user nova-compute[74701]: INFO nova.compute.manager [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Terminating instance
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-unplugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] No waiting events found dispatching network-vif-unplugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f0f21f4-28b1-42ee-a8ea-54103837f9f0 req-ba68d598-a06f-40d0-a9a2-57ea9f4600e6 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-unplugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Instance destroyed successfully.
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.objects.instance [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'resources' on Instance uuid cc61b092-3ef4-4b20-b02e-c8bb16586306 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-686995556',display_name='tempest-VolumesAdminNegativeTest-server-686995556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-686995556',id=13,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-63i820xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:10:08Z,user_data=None,user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=cc61b092-3ef4-4b20-b02e-c8bb16586306,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "address": "fa:16:3e:db:cf:fc", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aa958f-d2", "ovs_interfaceid": "98aa958f-d2c1-4f86-81dd-79473e3cf626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG os_vif [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98aa958f-d2, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2fe3b09-6ca8-4cbe-a8a5-b8dd708ea503) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:09 user nova-compute[74701]: INFO os_vif [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:cf:fc,bridge_name='br-int',has_traffic_filtering=True,id=98aa958f-d2c1-4f86-81dd-79473e3cf626,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98aa958f-d2')
Oct 20 13:12:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Deleting instance files /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306_del
Oct 20 13:12:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Deletion of /opt/stack/data/nova/instances/cc61b092-3ef4-4b20-b02e-c8bb16586306_del complete
Oct 20 13:12:10 user nova-compute[74701]: INFO nova.compute.manager [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 20 13:12:10 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:10 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Took 0.72 seconds to deallocate network for instance.
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-8da3b9c9-eae9-4b08-b199-073ac4155a84 req-57c9cdd3-3753-4726-a907-115020e70026 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-deleted-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:10 user nova-compute[74701]: INFO nova.compute.manager [req-8da3b9c9-eae9-4b08-b199-073ac4155a84 req-57c9cdd3-3753-4726-a907-115020e70026 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Neutron deleted interface 98aa958f-d2c1-4f86-81dd-79473e3cf626; detaching it from the instance and deleting it from the info cache
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-8da3b9c9-eae9-4b08-b199-073ac4155a84 req-57c9cdd3-3753-4726-a907-115020e70026 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-8da3b9c9-eae9-4b08-b199-073ac4155a84 req-57c9cdd3-3753-4726-a907-115020e70026 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Detach interface failed, port_id=98aa958f-d2c1-4f86-81dd-79473e3cf626, reason: Instance cc61b092-3ef4-4b20-b02e-c8bb16586306 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.023s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] Acquiring lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] No waiting events found dispatching network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:11 user nova-compute[74701]: WARNING nova.compute.manager [req-3fe69657-2efb-4405-946b-32f431f6195a req-f2063fe3-3140-4a41-9507-85a682b61b46 service nova] [instance: cc61b092-3ef4-4b20-b02e-c8bb16586306] Received unexpected event network-vif-plugged-98aa958f-d2c1-4f86-81dd-79473e3cf626 for instance with vm_state deleted and task_state None.
Oct 20 13:12:11 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Deleted allocations for instance cc61b092-3ef4-4b20-b02e-c8bb16586306
Oct 20 13:12:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-068d83ec-bae0-4085-9b54-e5062403a381 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "cc61b092-3ef4-4b20-b02e-c8bb16586306" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 4f50c459-c21a-4050-9d1c-730a224c8cf9 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid d275ea5d-2ee8-4474-be60-57675370409f {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d275ea5d-2ee8-4474-be60-57675370409f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d275ea5d-2ee8-4474-be60-57675370409f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:12:21 user nova-compute[74701]: INFO nova.compute.claims [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Claim successful on node user
Oct 20 13:12:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:12:21 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.policy [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e7c09b687b54750aceb6e2d4ddce16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff75c095f4304b76b10c26ee8e8cc489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:12:21 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Creating image(s)
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "/opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "/opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.269s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk 1073741824" returned: 0 in 0.063s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Successfully created port: 79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Cannot resize image /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Ensure instance console log exists: /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Successfully updated port: 79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquired lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-changed-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Refreshing instance network info cache due to event network-changed-79d66644-4692-4730-9f7e-7dbfe1814f7d. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] Acquiring lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Releasing lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Instance network_info: |[{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] Acquired lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.neutron [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Refreshing network info cache for port 79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Start _get_guest_xml network_info=[{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:12:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:23 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-221019941',display_name='tempest-ServersNegativeTestJSON-server-221019941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-221019941',id=16,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-j054vlh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:12:22Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=bbccb7d3-1e40-4e4e-9a8a-c012b73dc397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lazy-loading 'pci_devices' on Instance uuid bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:12:23 user nova-compute[74701]:   <uuid>bbccb7d3-1e40-4e4e-9a8a-c012b73dc397</uuid>
Oct 20 13:12:23 user nova-compute[74701]:   <name>instance-00000010</name>
Oct 20 13:12:23 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:12:23 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:12:23 user nova-compute[74701]:   <metadata>
Oct 20 13:12:23 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:12:23 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:name>tempest-ServersNegativeTestJSON-server-221019941</nova:name>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:12:23</nova:creationTime>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:12:23 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:12:23 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:owner>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:user uuid="5e7c09b687b54750aceb6e2d4ddce16f">tempest-ServersNegativeTestJSON-1044364652-project-member</nova:user>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:project uuid="ff75c095f4304b76b10c26ee8e8cc489">tempest-ServersNegativeTestJSON-1044364652</nova:project>
Oct 20 13:12:23 user nova-compute[74701]:       </nova:owner>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:12:23 user nova-compute[74701]:       <nova:ports>
Oct 20 13:12:23 user nova-compute[74701]:         <nova:port uuid="79d66644-4692-4730-9f7e-7dbfe1814f7d">
Oct 20 13:12:23 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:12:23 user nova-compute[74701]:         </nova:port>
Oct 20 13:12:23 user nova-compute[74701]:       </nova:ports>
Oct 20 13:12:23 user nova-compute[74701]:     </nova:instance>
Oct 20 13:12:23 user nova-compute[74701]:   </metadata>
Oct 20 13:12:23 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:12:23 user nova-compute[74701]:     <system>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="serial">bbccb7d3-1e40-4e4e-9a8a-c012b73dc397</entry>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="uuid">bbccb7d3-1e40-4e4e-9a8a-c012b73dc397</entry>
Oct 20 13:12:23 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:12:23 user nova-compute[74701]:     </system>
Oct 20 13:12:23 user nova-compute[74701]:   </sysinfo>
Oct 20 13:12:23 user nova-compute[74701]:   <os>
Oct 20 13:12:23 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:12:23 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:12:23 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:12:23 user nova-compute[74701]:   </os>
Oct 20 13:12:23 user nova-compute[74701]:   <features>
Oct 20 13:12:23 user nova-compute[74701]:     <acpi/>
Oct 20 13:12:23 user nova-compute[74701]:     <apic/>
Oct 20 13:12:23 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:12:23 user nova-compute[74701]:   </features>
Oct 20 13:12:23 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:12:23 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:12:23 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:12:23 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:12:23 user nova-compute[74701]:   </clock>
Oct 20 13:12:23 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:12:23 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:12:23 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:12:23 user nova-compute[74701]:   </cpu>
Oct 20 13:12:23 user nova-compute[74701]:   <devices>
Oct 20 13:12:23 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:12:23 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:12:23 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk"/>
Oct 20 13:12:23 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:12:23 user nova-compute[74701]:     </disk>
Oct 20 13:12:23 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:12:23 user nova-compute[74701]:       <mac address="fa:16:3e:06:1f:af"/>
Oct 20 13:12:23 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:12:23 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:12:23 user nova-compute[74701]:       <target dev="tap79d66644-46"/>
Oct 20 13:12:23 user nova-compute[74701]:     </interface>
Oct 20 13:12:23 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:12:23 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/console.log" append="off"/>
Oct 20 13:12:23 user nova-compute[74701]:     </serial>
Oct 20 13:12:23 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:12:23 user nova-compute[74701]:     <video>
Oct 20 13:12:23 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:12:23 user nova-compute[74701]:     </video>
Oct 20 13:12:23 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:12:23 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:12:23 user nova-compute[74701]:     </rng>
Oct 20 13:12:23 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:12:23 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:12:23 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:12:23 user nova-compute[74701]:     </memballoon>
Oct 20 13:12:23 user nova-compute[74701]:   </devices>
Oct 20 13:12:23 user nova-compute[74701]: </domain>
Oct 20 13:12:23 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-221019941',display_name='tempest-ServersNegativeTestJSON-server-221019941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-221019941',id=16,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-j054vlh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:12:22Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=bbccb7d3-1e40-4e4e-9a8a-c012b73dc397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG os_vif [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52a8b674-99bd-55fd-adfc-a3b777785d40', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d66644-46, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79d66644-46, col_values=(('qos', UUID('f6055a56-0630-40fe-bcf3-067ce22d48d6')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79d66644-46, col_values=(('external_ids', {'iface-id': '79d66644-4692-4730-9f7e-7dbfe1814f7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:1f:af', 'vm-uuid': 'bbccb7d3-1e40-4e4e-9a8a-c012b73dc397'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:24 user nova-compute[74701]: INFO os_vif [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46')
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] No VIF found with MAC fa:16:3e:06:1f:af, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updated VIF entry in instance network info cache for port 79d66644-4692-4730-9f7e-7dbfe1814f7d. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6773138d-2a00-486b-8c2f-097e01cebb7a req-d809c9bf-ac4c-4a60-b94b-9a1ec6b86f4d service nova] Releasing lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] No waiting events found dispatching network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:25 user nova-compute[74701]: WARNING nova.compute.manager [req-d6f3d89a-b947-4848-a58f-e618c1692a41 req-342a61b2-6712-42c9-a44f-5e743d758c5b service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received unexpected event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d for instance with vm_state building and task_state spawning.
Oct 20 13:12:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] No waiting events found dispatching network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:27 user nova-compute[74701]: WARNING nova.compute.manager [req-b7aa0cd2-6cb9-42bd-a7dc-d6b00dd57392 req-187fb863-db6d-4fa0-af6e-f60d8e43af04 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received unexpected event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d for instance with vm_state building and task_state spawning.
Oct 20 13:12:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Instance spawned successfully.
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:12:28 user nova-compute[74701]: INFO nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 20 13:12:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:12:28 user nova-compute[74701]: INFO nova.compute.manager [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Took 7.09 seconds to build instance.
Oct 20 13:12:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8bdb93ea-fb4c-4ea9-8ffc-71c10598c2b8 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.210s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:33 user nova-compute[74701]: INFO nova.compute.manager [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Terminating instance
Oct 20 13:12:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-unplugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] No waiting events found dispatching network-vif-unplugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-9a110dd8-85ab-4209-b22b-78fe03d75403 req-15026891-a94b-4a7f-b0ad-2dfd8039f754 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-unplugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:12:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Instance destroyed successfully.
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'resources' on Instance uuid d8e28db3-6b19-459f-b314-09ede99f9c8d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334892862',display_name='tempest-AttachVolumeNegativeTest-server-1334892862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334892862',id=1,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUxYE44T75VtBrflpaKhEMNEZhQDw64O2iNhYKC4+fp6W98u0YXiL6C7iZ4KmYwHqjT7S7ObHL53yKWA8P85VGwdchfxuzyZdil6Wh0jwqFComHEr7cB52mur6lownrPg==',key_name='tempest-keypair-224864113',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-ka1dhi1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=d8e28db3-6b19-459f-b314-09ede99f9c8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "address": "fa:16:3e:4b:be:64", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e31c1-68", "ovs_interfaceid": "8a6e31c1-6831-440c-b25b-732eece5dfa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG os_vif [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a6e31c1-68, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c0aaaa5-7b28-4551-a5b3-2c6e49201567) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:34 user nova-compute[74701]: INFO os_vif [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:be:64,bridge_name='br-int',has_traffic_filtering=True,id=8a6e31c1-6831-440c-b25b-732eece5dfa5,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e31c1-68')
Oct 20 13:12:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Deleting instance files /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d_del
Oct 20 13:12:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Deletion of /opt/stack/data/nova/instances/d8e28db3-6b19-459f-b314-09ede99f9c8d_del complete
Oct 20 13:12:34 user nova-compute[74701]: INFO nova.compute.manager [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 20 13:12:34 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:12:34 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:12:35 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:35 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Took 1.02 seconds to deallocate network for instance.
Oct 20 13:12:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-a10e1449-f218-4741-b18d-1f37b84297b9 req-73be7ec3-cafc-4c0e-8b46-1e1e7a7cdde9 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-deleted-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:36 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Deleted allocations for instance d8e28db3-6b19-459f-b314-09ede99f9c8d
Oct 20 13:12:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] Acquiring lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] No waiting events found dispatching network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:36 user nova-compute[74701]: WARNING nova.compute.manager [req-32fa9587-80d4-46ae-8bdb-a844b6676d6d req-0e60340a-5f60-469c-a6f3-e6c4f9fc7d82 service nova] [instance: d8e28db3-6b19-459f-b314-09ede99f9c8d] Received unexpected event network-vif-plugged-8a6e31c1-6831-440c-b25b-732eece5dfa5 for instance with vm_state deleted and task_state None.
Oct 20 13:12:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-289527ce-d429-4d2e-925a-5cfd87b7d5f5 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "d8e28db3-6b19-459f-b314-09ede99f9c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:42 user nova-compute[74701]: INFO nova.compute.manager [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Unrescuing
Oct 20 13:12:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:42 user nova-compute[74701]: DEBUG nova.network.neutron [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG nova.network.neutron [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG nova.objects.instance [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'flavor' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:43 user nova-compute[74701]: WARNING nova.compute.manager [req-b2ac6cac-8d1b-441a-b415-5d7b75357897 req-a1c5f19e-4177-4031-8200-8948684b9fc2 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:12:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance destroyed successfully.
Oct 20 13:12:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:45 user nova-compute[74701]: INFO nova.compute.manager [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Terminating instance
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-d03fb0f9-5ed2-4a6d-8e32-1e2f01e4907b req-871ec30d-e9b6-41ba-b14b-70efedd5a1a2 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:45 user nova-compute[74701]: WARNING nova.compute.manager [req-9a61fd23-5d06-448f-81bf-09a5ade77472 req-d5fb70bc-5fe0-4fcf-8d8b-ee4a88e5f392 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Instance destroyed successfully.
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.objects.instance [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lazy-loading 'resources' on Instance uuid d275ea5d-2ee8-4474-be60-57675370409f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1074964372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1631351501',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA9PWzHvFLwvOk0yhX648y0zlsujC3piIOQ5XN+feAXy1bqsOoLsn2eZOW6E/ptckhUqcp8jl2IpuhhAX5xLQZszMmteI9M7iwxML0ysMg+MK5ZRe7azUfUyM5SF7S2TQ==',key_name='tempest-keypair-1032484164',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f284b2af22754158b35ab6e7b8182fef',ramdisk_id='',reservation_id='r-q2sw0jo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1180019451',owner_user_name='tempest-ServerActionsV293TestJSON-1180019451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0429fbfe8ec14007b53153f70294e75d',uuid=d275ea5d-2ee8-4474-be60-57675370409f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converting VIF {"id": "8e5d0654-5690-49ac-a149-0283de693b26", "address": "fa:16:3e:2d:d9:6a", "network": {"id": "5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1928916215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f284b2af22754158b35ab6e7b8182fef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5d0654-56", "ovs_interfaceid": "8e5d0654-5690-49ac-a149-0283de693b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_vif [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e5d0654-56, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f8c63f0-5fca-41ad-b94a-522c8b6b8180) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:46 user nova-compute[74701]: INFO os_vif [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d9:6a,bridge_name='br-int',has_traffic_filtering=True,id=8e5d0654-5690-49ac-a149-0283de693b26,network=Network(5b9b4573-706a-4cfa-8a6c-f9c2a9a2aa5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5d0654-56')
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYSPkqax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:12:46 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[913448a4-8014-4918-8612-70b3191abb52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:12:46 user nova-compute[74701]: No targets found.
Oct 20 13:12:46 user nova-compute[74701]: iSNS:
Oct 20 13:12:46 user nova-compute[74701]: No targets found.
Oct 20 13:12:46 user nova-compute[74701]: STATIC:
Oct 20 13:12:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38
Oct 20 13:12:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:12:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:12:46 user nova-compute[74701]: FIRMWARE:
Oct 20 13:12:46 user nova-compute[74701]: No targets found.
Oct 20 13:12:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:12:46 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:12:46 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798d6a7-2fb7-43d3-93e8-f6bf6ced4aeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f89ed6-51b7-42af-a959-47de64ee914a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:12:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 (non-flash)
Oct 20 13:12:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc719750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[beadf3be-d4b1-4c57-aacd-2840cd8d3a6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118f13f-b7b8-4bd2-9f57-13fdd7b0b4c2]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ec74ba-1efd-4f34-8029-d4183166b23e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0cd1bf-6a2e-4b66-9b6b-06bafa92c253]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfbe23c-86dd-427d-934d-19e726ea538a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7bdb11-171a-449a-b18b-813806691d27]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260]
Oct 20 13:12:46 user nova-compute[74701]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38, portal: 172.16.0.220,3260] successful.
Oct 20 13:12:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8130bccf-b499-4013-a02e-294619154a38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93414a-2025-48b6-82d0-15222f74d1dd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] <== disconnect_volume: return (326ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:12:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deleting instance files /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f_del
Oct 20 13:12:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deletion of /opt/stack/data/nova/instances/d275ea5d-2ee8-4474-be60-57675370409f_del complete
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:46 user nova-compute[74701]: INFO nova.compute.manager [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Took 1.76 seconds to destroy the instance on the hypervisor.
Oct 20 13:12:46 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:12:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state deleting.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state deleting.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state deleting.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-unplugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Acquiring lock "d275ea5d-2ee8-4474-be60-57675370409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] Lock "d275ea5d-2ee8-4474-be60-57675370409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] No waiting events found dispatching network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-65f99ffb-9ae0-42f0-ba05-fcc10bbd41bc req-5fd9210f-7712-4f7a-a113-adf09f680efb service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received unexpected event network-vif-plugged-8e5d0654-5690-49ac-a149-0283de693b26 for instance with vm_state active and task_state deleting.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:47 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Took 0.89 seconds to deallocate network for instance.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:12:47 user nova-compute[74701]: WARNING nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:12:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-e947554d-c558-48fa-9c71-47ade85a37b9 req-7a4fb540-e19e-4f58-bc52-b9afeb456363 service nova] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Received event network-vif-deleted-8e5d0654-5690-49ac-a149-0283de693b26 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-02e7471d-3d92-4b00-86d3-22fb361e17d1 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:12:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:12:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:56 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:56 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:56 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7988MB free_disk=25.322246551513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4f50c459-c21a-4050-9d1c-730a224c8cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d275ea5d-2ee8-4474-be60-57675370409f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 49cd00ef-639e-45d4-8681-4076ce232be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.437s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:12:57 user nova-compute[74701]: INFO nova.compute.claims [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Claim successful on node user
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:12:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:12:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.policy [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f600c832acd2409c973cfa387a018967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9321569f0e5b4ca49120669fcd48f80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:12:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Creating image(s)
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:58 user nova-compute[74701]: INFO nova.compute.manager [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Took 10.60 seconds to detach 1 volumes for instance.
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] [instance: d275ea5d-2ee8-4474-be60-57675370409f] Deleting volume: 8130bccf-b499-4013-a02e-294619154a38 {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk 1073741824" returned: 0 in 0.060s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Successfully created port: ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.201s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Cannot resize image /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Ensure instance console log exists: /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:59 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Deleted allocations for instance d275ea5d-2ee8-4474-be60-57675370409f
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-beacc152-000c-4d30-84e7-8ad049ae27a2 tempest-ServerActionsV293TestJSON-1180019451 tempest-ServerActionsV293TestJSON-1180019451-project-member] Lock "d275ea5d-2ee8-4474-be60-57675370409f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.016s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Successfully updated port: ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-changed-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Refreshing instance network info cache due to event network-changed-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Skipping network cache update for instance because it is Building. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance network_info: |[{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Refreshing network info cache for port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start _get_guest_xml network_info=[{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:12:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'pci_devices' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:12:59 user nova-compute[74701]:   <uuid>e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</uuid>
Oct 20 13:12:59 user nova-compute[74701]:   <name>instance-00000011</name>
Oct 20 13:12:59 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:12:59 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:12:59 user nova-compute[74701]:   <metadata>
Oct 20 13:12:59 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:12:59 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherB-server-950766450</nova:name>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:12:59</nova:creationTime>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:12:59 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:12:59 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:owner>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:user uuid="f600c832acd2409c973cfa387a018967">tempest-ServerActionsTestOtherB-1560345207-project-member</nova:user>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:project uuid="9321569f0e5b4ca49120669fcd48f80b">tempest-ServerActionsTestOtherB-1560345207</nova:project>
Oct 20 13:12:59 user nova-compute[74701]:       </nova:owner>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:12:59 user nova-compute[74701]:       <nova:ports>
Oct 20 13:12:59 user nova-compute[74701]:         <nova:port uuid="ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4">
Oct 20 13:12:59 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:12:59 user nova-compute[74701]:         </nova:port>
Oct 20 13:12:59 user nova-compute[74701]:       </nova:ports>
Oct 20 13:12:59 user nova-compute[74701]:     </nova:instance>
Oct 20 13:12:59 user nova-compute[74701]:   </metadata>
Oct 20 13:12:59 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:12:59 user nova-compute[74701]:     <system>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="serial">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="uuid">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:12:59 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:12:59 user nova-compute[74701]:     </system>
Oct 20 13:12:59 user nova-compute[74701]:   </sysinfo>
Oct 20 13:12:59 user nova-compute[74701]:   <os>
Oct 20 13:12:59 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:12:59 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:12:59 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:12:59 user nova-compute[74701]:   </os>
Oct 20 13:12:59 user nova-compute[74701]:   <features>
Oct 20 13:12:59 user nova-compute[74701]:     <acpi/>
Oct 20 13:12:59 user nova-compute[74701]:     <apic/>
Oct 20 13:12:59 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:12:59 user nova-compute[74701]:   </features>
Oct 20 13:12:59 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:12:59 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:12:59 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:12:59 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:12:59 user nova-compute[74701]:   </clock>
Oct 20 13:12:59 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:12:59 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:12:59 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:12:59 user nova-compute[74701]:   </cpu>
Oct 20 13:12:59 user nova-compute[74701]:   <devices>
Oct 20 13:12:59 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:12:59 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:12:59 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk"/>
Oct 20 13:12:59 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:12:59 user nova-compute[74701]:     </disk>
Oct 20 13:12:59 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:12:59 user nova-compute[74701]:       <mac address="fa:16:3e:db:3b:2b"/>
Oct 20 13:12:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:12:59 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:12:59 user nova-compute[74701]:       <target dev="tapffbb1918-8d"/>
Oct 20 13:12:59 user nova-compute[74701]:     </interface>
Oct 20 13:12:59 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:12:59 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/console.log" append="off"/>
Oct 20 13:12:59 user nova-compute[74701]:     </serial>
Oct 20 13:12:59 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:12:59 user nova-compute[74701]:     <video>
Oct 20 13:12:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:12:59 user nova-compute[74701]:     </video>
Oct 20 13:12:59 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:12:59 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:12:59 user nova-compute[74701]:     </rng>
Oct 20 13:12:59 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:12:59 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:12:59 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:12:59 user nova-compute[74701]:     </memballoon>
Oct 20 13:12:59 user nova-compute[74701]:   </devices>
Oct 20 13:12:59 user nova-compute[74701]: </domain>
Oct 20 13:12:59 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG os_vif [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb872d2e-b646-5e04-8321-ad2508627898', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffbb1918-8d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffbb1918-8d, col_values=(('qos', UUID('61075fa5-2bd7-49c5-93da-0a7aa52fba65')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffbb1918-8d, col_values=(('external_ids', {'iface-id': 'ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3b:2b', 'vm-uuid': 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:12:59 user nova-compute[74701]: INFO os_vif [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:12:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No VIF found with MAC fa:16:3e:db:3b:2b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updated VIF entry in instance network info cache for port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-29e76ce3-aa67-4437-9922-a1e8d60f6b04 req-20f86f4a-041e-4faa-98b1-94b5f3832935 service nova] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:01 user nova-compute[74701]: WARNING nova.compute.manager [req-90a4d0b2-3e32-4b24-bc33-18272310d768 req-01067a92-6c34-4c39-83e8-3920a829b6d4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state building and task_state spawning.
Oct 20 13:13:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:03 user nova-compute[74701]: WARNING nova.compute.manager [req-1093b4ae-560d-4afa-b8dc-64a5a06ddb8a req-86118bbb-0a1d-4861-900b-fab1c30a16b4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state building and task_state spawning.
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:13:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance spawned successfully.
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:03 user nova-compute[74701]: INFO nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Took 5.83 seconds to spawn the instance on the hypervisor.
Oct 20 13:13:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:13:04 user nova-compute[74701]: INFO nova.compute.manager [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Took 7.01 seconds to build instance.
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c51eeaff-7542-438d-bd2b-68561c5ddc5c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.130s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:04 user nova-compute[74701]: INFO nova.compute.manager [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Terminating instance
Oct 20 13:13:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-unplugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] No waiting events found dispatching network-vif-unplugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-75bc0fe4-372c-41c8-ab02-d30afceb075f req-37dd2256-a230-4e48-b72c-9c659a21233d service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-unplugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:13:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Instance destroyed successfully.
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lazy-loading 'resources' on Instance uuid 4f50c459-c21a-4050-9d1c-730a224c8cf9 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-17466101',display_name='tempest-ServerStableDeviceRescueTest-server-17466101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-17466101',id=4,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiYtoKkFTmshdDUNXqr+S1h49XYGSKmEtp28zlHIlpcmLfdgYaXu0MKiXcXtGFaFkrgozFStitE5dNkOXy5nD0JXiQ7epwGTBR652B6ofG61gfnhspKVCSklByJrdPEEQ==',key_name='tempest-keypair-864934035',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6d495846294351927fa53aea7dd842',ramdisk_id='',reservation_id='r-0kfsar65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1514521890',owner_user_name='tempest-ServerStableDeviceRescueTest-1514521890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a7b9ce56444a689c334637d0a6ec37',uuid=4f50c459-c21a-4050-9d1c-730a224c8cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converting VIF {"id": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "address": "fa:16:3e:b7:33:20", "network": {"id": "a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-362755423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6d495846294351927fa53aea7dd842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89b2ae8-cb", "ovs_interfaceid": "b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG os_vif [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb89b2ae8-cb, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24fbe8c7-76fc-493f-94ee-261292eacc0f) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:05 user nova-compute[74701]: INFO os_vif [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:33:20,bridge_name='br-int',has_traffic_filtering=True,id=b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0,network=Network(a8dcc5c7-c2cb-4311-9a99-2af5ad952f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89b2ae8-cb')
Oct 20 13:13:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Deleting instance files /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9_del
Oct 20 13:13:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Deletion of /opt/stack/data/nova/instances/4f50c459-c21a-4050-9d1c-730a224c8cf9_del complete
Oct 20 13:13:05 user nova-compute[74701]: INFO nova.compute.manager [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 13:13:05 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:13:05 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:06 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Took 0.95 seconds to deallocate network for instance.
Oct 20 13:13:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:13:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:06 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Deleted allocations for instance 4f50c459-c21a-4050-9d1c-730a224c8cf9
Oct 20 13:13:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7f8b816d-9e56-4fb0-ac8c-0f71ae1241a0 tempest-ServerStableDeviceRescueTest-1514521890 tempest-ServerStableDeviceRescueTest-1514521890-project-member] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] Acquiring lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] Lock "4f50c459-c21a-4050-9d1c-730a224c8cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] No waiting events found dispatching network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:07 user nova-compute[74701]: WARNING nova.compute.manager [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received unexpected event network-vif-plugged-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 for instance with vm_state deleted and task_state None.
Oct 20 13:13:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-a3b0fa2f-5bd2-44d6-985a-90d2ba14a97a req-28980bf9-e3fb-4602-ac90-de335e154a15 service nova] [instance: 4f50c459-c21a-4050-9d1c-730a224c8cf9] Received event network-vif-deleted-b89b2ae8-cb3e-434b-8e24-79ee0dd0ccd0 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:10 user nova-compute[74701]: INFO nova.compute.manager [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Terminating instance
Oct 20 13:13:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-unplugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] No waiting events found dispatching network-vif-unplugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-b0c23420-6cc1-4679-bafb-be8c3271a3f6 req-ad75ed71-0bb1-404e-9e08-3dc76512bbe5 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-unplugged-038c3665-0c3f-4ebb-b170-e3764a313137 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:13:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Instance destroyed successfully.
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lazy-loading 'resources' on Instance uuid b8dbbea7-4330-4bdd-adea-7b28bfca9726 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2012380686',display_name='tempest-VolumesAdminNegativeTest-server-2012380686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2012380686',id=5,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkedxgu7emfvAUh9ykf7WbEvPJOZUyY4Ar3wOh23+vTSLe1FpvWzpwYm3YBeLokxaR8+ISzaBI86o5sAZri9riM8aS653N20S4Npyh2gutObOUuLhK5WFMDUIlvwY28cA==',key_name='tempest-keypair-1775119559',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04d3196b12fd43c183b0b9e8324efa5c',ramdisk_id='',reservation_id='r-w5ltex07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-245051053',owner_user_name='tempest-VolumesAdminNegativeTest-245051053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e643924dcc704c3bacad93ee0dd803dc',uuid=b8dbbea7-4330-4bdd-adea-7b28bfca9726,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converting VIF {"id": "038c3665-0c3f-4ebb-b170-e3764a313137", "address": "fa:16:3e:2c:53:84", "network": {"id": "4ba9f8a3-344f-4ac7-8b13-10eb2e76decf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1751003352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d3196b12fd43c183b0b9e8324efa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c3665-0c", "ovs_interfaceid": "038c3665-0c3f-4ebb-b170-e3764a313137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG os_vif [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038c3665-0c, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56203af5-788e-429c-a842-2d1cade84209) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:11 user nova-compute[74701]: INFO os_vif [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:53:84,bridge_name='br-int',has_traffic_filtering=True,id=038c3665-0c3f-4ebb-b170-e3764a313137,network=Network(4ba9f8a3-344f-4ac7-8b13-10eb2e76decf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c3665-0c')
Oct 20 13:13:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Deleting instance files /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726_del
Oct 20 13:13:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Deletion of /opt/stack/data/nova/instances/b8dbbea7-4330-4bdd-adea-7b28bfca9726_del complete
Oct 20 13:13:11 user nova-compute[74701]: INFO nova.compute.manager [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 13:13:11 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:13:11 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:13:12 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:12 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Took 0.99 seconds to deallocate network for instance.
Oct 20 13:13:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0311282-945c-4bd0-ab5d-a62c191a9741 req-a91b5999-49da-4e1f-8116-dc5e298475a4 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-deleted-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:12 user nova-compute[74701]: INFO nova.compute.manager [req-d0311282-945c-4bd0-ab5d-a62c191a9741 req-a91b5999-49da-4e1f-8116-dc5e298475a4 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Neutron deleted interface 038c3665-0c3f-4ebb-b170-e3764a313137; detaching it from the instance and deleting it from the info cache
Oct 20 13:13:12 user nova-compute[74701]: DEBUG nova.network.neutron [req-d0311282-945c-4bd0-ab5d-a62c191a9741 req-a91b5999-49da-4e1f-8116-dc5e298475a4 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0311282-945c-4bd0-ab5d-a62c191a9741 req-a91b5999-49da-4e1f-8116-dc5e298475a4 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Detach interface failed, port_id=038c3665-0c3f-4ebb-b170-e3764a313137, reason: Instance b8dbbea7-4330-4bdd-adea-7b28bfca9726 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:13:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:13 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Deleted allocations for instance b8dbbea7-4330-4bdd-adea-7b28bfca9726
Oct 20 13:13:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b12645e3-a2d2-4584-b30a-1db529a6f042 tempest-VolumesAdminNegativeTest-245051053 tempest-VolumesAdminNegativeTest-245051053-project-member] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.419s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] Acquiring lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] Lock "b8dbbea7-4330-4bdd-adea-7b28bfca9726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] No waiting events found dispatching network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:13 user nova-compute[74701]: WARNING nova.compute.manager [req-4f741837-739b-4e9e-925b-0e0e0ff974dd req-c131d884-18f0-44dd-bdb7-74b24130ea79 service nova] [instance: b8dbbea7-4330-4bdd-adea-7b28bfca9726] Received unexpected event network-vif-plugged-038c3665-0c3f-4ebb-b170-e3764a313137 for instance with vm_state deleted and task_state None.
Oct 20 13:13:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:13:26 user nova-compute[74701]: INFO nova.compute.manager [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] instance snapshotting
Oct 20 13:13:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Beginning live snapshot process
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e.delta 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e.delta 1073741824" returned: 0 in 0.055s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 13:13:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:13:28 user nova-compute[74701]: INFO nova.compute.claims [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Claim successful on node user
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 1114112 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:13:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.policy [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09e73f4fb1c410db0d365d04722a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea6d60f8e654cc2af2ec7085c001ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:13:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:13:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Creating image(s)
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e.delta /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e.delta /opt/stack/data/nova/instances/snapshots/tmpn9mbk1zf/db0838b35e5848259da133d82eb86b7e" returned: 0 in 0.323s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Snapshot extracted, beginning image upload
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk 1073741824" returned: 0 in 0.052s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Successfully created port: 377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.228s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:13:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Cannot resize image /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Ensure instance console log exists: /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Successfully updated port: 377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquired lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-changed-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Refreshing instance network info cache due to event network-changed-377c2851-f2c8-4169-9d10-11543a0254ec. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] Acquiring lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updating instance_info_cache with network_info: [{"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Releasing lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Instance network_info: |[{"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] Acquired lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Refreshing network info cache for port 377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Start _get_guest_xml network_info=[{"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:13:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:13:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208353718',display_name='tempest-AttachVolumeNegativeTest-server-208353718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208353718',id=18,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLOjzODboKn9Us81I5rmSrTgEVEvCKaO1m0CGNeI7oblx+fkv3nI24eCKa5QwsIKxBEyQv+Pl0N0bQFwuGIU2SxL96KHw7cdpXHcuTQ92SZ4MDlw4qOdVdWhX7J5EddGQ==',key_name='tempest-keypair-657395957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-sh2ems2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:13:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=b8ca3042-e49a-4ae4-83f3-4e3512d39a86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.objects.instance [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'pci_devices' on Instance uuid b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:13:31 user nova-compute[74701]:   <uuid>b8ca3042-e49a-4ae4-83f3-4e3512d39a86</uuid>
Oct 20 13:13:31 user nova-compute[74701]:   <name>instance-00000012</name>
Oct 20 13:13:31 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:13:31 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:13:31 user nova-compute[74701]:   <metadata>
Oct 20 13:13:31 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:13:31 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeNegativeTest-server-208353718</nova:name>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:13:30</nova:creationTime>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:13:31 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:13:31 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:owner>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:user uuid="a09e73f4fb1c410db0d365d04722a4fe">tempest-AttachVolumeNegativeTest-1431718944-project-member</nova:user>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:project uuid="3ea6d60f8e654cc2af2ec7085c001ea1">tempest-AttachVolumeNegativeTest-1431718944</nova:project>
Oct 20 13:13:31 user nova-compute[74701]:       </nova:owner>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:13:31 user nova-compute[74701]:       <nova:ports>
Oct 20 13:13:31 user nova-compute[74701]:         <nova:port uuid="377c2851-f2c8-4169-9d10-11543a0254ec">
Oct 20 13:13:31 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 13:13:31 user nova-compute[74701]:         </nova:port>
Oct 20 13:13:31 user nova-compute[74701]:       </nova:ports>
Oct 20 13:13:31 user nova-compute[74701]:     </nova:instance>
Oct 20 13:13:31 user nova-compute[74701]:   </metadata>
Oct 20 13:13:31 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:13:31 user nova-compute[74701]:     <system>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="serial">b8ca3042-e49a-4ae4-83f3-4e3512d39a86</entry>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="uuid">b8ca3042-e49a-4ae4-83f3-4e3512d39a86</entry>
Oct 20 13:13:31 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:13:31 user nova-compute[74701]:     </system>
Oct 20 13:13:31 user nova-compute[74701]:   </sysinfo>
Oct 20 13:13:31 user nova-compute[74701]:   <os>
Oct 20 13:13:31 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:13:31 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:13:31 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:13:31 user nova-compute[74701]:   </os>
Oct 20 13:13:31 user nova-compute[74701]:   <features>
Oct 20 13:13:31 user nova-compute[74701]:     <acpi/>
Oct 20 13:13:31 user nova-compute[74701]:     <apic/>
Oct 20 13:13:31 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:13:31 user nova-compute[74701]:   </features>
Oct 20 13:13:31 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:13:31 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:13:31 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:13:31 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:13:31 user nova-compute[74701]:   </clock>
Oct 20 13:13:31 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:13:31 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:13:31 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:13:31 user nova-compute[74701]:   </cpu>
Oct 20 13:13:31 user nova-compute[74701]:   <devices>
Oct 20 13:13:31 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:13:31 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:13:31 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk"/>
Oct 20 13:13:31 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:13:31 user nova-compute[74701]:     </disk>
Oct 20 13:13:31 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:13:31 user nova-compute[74701]:       <mac address="fa:16:3e:12:c9:35"/>
Oct 20 13:13:31 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:13:31 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:13:31 user nova-compute[74701]:       <target dev="tap377c2851-f2"/>
Oct 20 13:13:31 user nova-compute[74701]:     </interface>
Oct 20 13:13:31 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:13:31 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/console.log" append="off"/>
Oct 20 13:13:31 user nova-compute[74701]:     </serial>
Oct 20 13:13:31 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:13:31 user nova-compute[74701]:     <video>
Oct 20 13:13:31 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:13:31 user nova-compute[74701]:     </video>
Oct 20 13:13:31 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:13:31 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:13:31 user nova-compute[74701]:     </rng>
Oct 20 13:13:31 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:13:31 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:13:31 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:13:31 user nova-compute[74701]:     </memballoon>
Oct 20 13:13:31 user nova-compute[74701]:   </devices>
Oct 20 13:13:31 user nova-compute[74701]: </domain>
Oct 20 13:13:31 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208353718',display_name='tempest-AttachVolumeNegativeTest-server-208353718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208353718',id=18,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLOjzODboKn9Us81I5rmSrTgEVEvCKaO1m0CGNeI7oblx+fkv3nI24eCKa5QwsIKxBEyQv+Pl0N0bQFwuGIU2SxL96KHw7cdpXHcuTQ92SZ4MDlw4qOdVdWhX7J5EddGQ==',key_name='tempest-keypair-657395957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-sh2ems2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:13:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=b8ca3042-e49a-4ae4-83f3-4e3512d39a86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG os_vif [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '235670a5-944b-5326-8993-a47ff94f1753', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap377c2851-f2, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap377c2851-f2, col_values=(('qos', UUID('5292546e-8156-477b-b601-93af15c2c440')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap377c2851-f2, col_values=(('external_ids', {'iface-id': '377c2851-f2c8-4169-9d10-11543a0254ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:c9:35', 'vm-uuid': 'b8ca3042-e49a-4ae4-83f3-4e3512d39a86'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: INFO os_vif [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2')
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:12:c9:35, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.neutron [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updated VIF entry in instance network info cache for port 377c2851-f2c8-4169-9d10-11543a0254ec. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG nova.network.neutron [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updating instance_info_cache with network_info: [{"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45c995b2-951e-4103-915a-7d0bcf10687f req-7f711053-aac8-4157-a557-ad551e0b8d3d service nova] Releasing lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Snapshot image upload complete
Oct 20 13:13:32 user nova-compute[74701]: INFO nova.compute.manager [None req-5b395d20-fdc7-4ebf-b4b3-645d4229d444 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Took 5.61 seconds to snapshot the instance on the hypervisor.
Oct 20 13:13:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] No waiting events found dispatching network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:32 user nova-compute[74701]: WARNING nova.compute.manager [req-cd80cded-ba9d-497e-8d5c-e2af3bdc18d7 req-04e0d54d-e574-45a3-be3c-580ef3e42adc service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received unexpected event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec for instance with vm_state building and task_state spawning.
Oct 20 13:13:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:13:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Instance spawned successfully.
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:34 user nova-compute[74701]: INFO nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Took 5.51 seconds to spawn the instance on the hypervisor.
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] No waiting events found dispatching network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:34 user nova-compute[74701]: WARNING nova.compute.manager [req-0f6a650d-4520-4692-967d-a0bfda0256d9 req-f3242287-6f90-42a6-9637-834f56432e2f service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received unexpected event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec for instance with vm_state building and task_state spawning.
Oct 20 13:13:34 user nova-compute[74701]: INFO nova.compute.manager [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Took 6.33 seconds to build instance.
Oct 20 13:13:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-513666ee-a6b1-408d-9550-9044f9520a93 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.458s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-changed-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Refreshing instance network info cache due to event network-changed-41f10cfb-5dbc-44f7-989c-3d550aef436c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:13:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] Acquiring lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:13:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] Acquired lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:13:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Refreshing network info cache for port 41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lazy-loading 'flavor' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updated VIF entry in instance network info cache for port 41f10cfb-5dbc-44f7-989c-3d550aef436c. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updating instance_info_cache with network_info: [{"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:39 user nova-compute[74701]: INFO nova.compute.manager [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attaching volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48 to /dev/vdb
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2ee1f195-465a-49ee-b9e7-60d4c7b176c2 req-2e40e51f-c7d5-4e63-a10f-a8a91a0e0720 service nova] Releasing lock "refresh_cache-49cd00ef-639e-45d4-8681-4076ce232be8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.utils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f76def4-2a68-437e-a256-bb5044c0bdce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aaafa0-254e-45eb-bd0e-c92ffd58c236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77910167-8d85-415c-8728-1d0b1883baf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f5868-7faa-4137-8660-cf204aa1cd35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:13:39 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:13:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d38c460-fe10-48ae-adb3-46384c76b416]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG os_brick.utils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:13:39 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updating existing volume attachment record: 6c76f65a-ee9f-4c29-9153-48b64bdddff0 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:13:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:13:51 user nova-compute[74701]: INFO nova.compute.claims [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Claim successful on node user
Oct 20 13:13:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:13:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:13:51 user nova-compute[74701]: DEBUG nova.policy [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22371d97e6c1416499916660b5b2b07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf15939da12479f9c7bfff1c4198efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:13:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Creating image(s)
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk 1073741824" returned: 0 in 0.060s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Successfully created port: 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Cannot resize image /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Ensure instance console log exists: /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Successfully updated port: 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing instance network info cache due to event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance network_info: |[{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start _get_guest_xml network_info=[{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:13:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/KEWGZFGCLdFwPKV1pah4nx6zxk2pfe5LGo37B+gmjIBM0NERgCoGz1dUbwQukcpOrm0jVNFGkc1pxWH6BlZNotFKl8swMLaq8bkOXQbIUvmpXI5M6ow4RZFwsMWz4mg==',key_name='tempest-keypair-704380112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_devices' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:13:53 user nova-compute[74701]:   <uuid>39db995b-5a3b-4077-97fc-81996bb88dd8</uuid>
Oct 20 13:13:53 user nova-compute[74701]:   <name>instance-00000013</name>
Oct 20 13:13:53 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:13:53 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:13:53 user nova-compute[74701]:   <metadata>
Oct 20 13:13:53 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:13:53 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1514932320</nova:name>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:13:53</nova:creationTime>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:13:53 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:13:53 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:owner>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:user uuid="22371d97e6c1416499916660b5b2b07e">tempest-AttachVolumeShelveTestJSON-1805146529-project-member</nova:user>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:project uuid="eaf15939da12479f9c7bfff1c4198efe">tempest-AttachVolumeShelveTestJSON-1805146529</nova:project>
Oct 20 13:13:53 user nova-compute[74701]:       </nova:owner>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:13:53 user nova-compute[74701]:       <nova:ports>
Oct 20 13:13:53 user nova-compute[74701]:         <nova:port uuid="119c01dd-e22d-4d3d-a529-b1a16a01f9a8">
Oct 20 13:13:53 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:13:53 user nova-compute[74701]:         </nova:port>
Oct 20 13:13:53 user nova-compute[74701]:       </nova:ports>
Oct 20 13:13:53 user nova-compute[74701]:     </nova:instance>
Oct 20 13:13:53 user nova-compute[74701]:   </metadata>
Oct 20 13:13:53 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:13:53 user nova-compute[74701]:     <system>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="serial">39db995b-5a3b-4077-97fc-81996bb88dd8</entry>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="uuid">39db995b-5a3b-4077-97fc-81996bb88dd8</entry>
Oct 20 13:13:53 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:13:53 user nova-compute[74701]:     </system>
Oct 20 13:13:53 user nova-compute[74701]:   </sysinfo>
Oct 20 13:13:53 user nova-compute[74701]:   <os>
Oct 20 13:13:53 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:13:53 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:13:53 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:13:53 user nova-compute[74701]:   </os>
Oct 20 13:13:53 user nova-compute[74701]:   <features>
Oct 20 13:13:53 user nova-compute[74701]:     <acpi/>
Oct 20 13:13:53 user nova-compute[74701]:     <apic/>
Oct 20 13:13:53 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:13:53 user nova-compute[74701]:   </features>
Oct 20 13:13:53 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:13:53 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:13:53 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:13:53 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:13:53 user nova-compute[74701]:   </clock>
Oct 20 13:13:53 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:13:53 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:13:53 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:13:53 user nova-compute[74701]:   </cpu>
Oct 20 13:13:53 user nova-compute[74701]:   <devices>
Oct 20 13:13:53 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:13:53 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:13:53 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk"/>
Oct 20 13:13:53 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:13:53 user nova-compute[74701]:     </disk>
Oct 20 13:13:53 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:13:53 user nova-compute[74701]:       <mac address="fa:16:3e:17:a3:23"/>
Oct 20 13:13:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:13:53 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:13:53 user nova-compute[74701]:       <target dev="tap119c01dd-e2"/>
Oct 20 13:13:53 user nova-compute[74701]:     </interface>
Oct 20 13:13:53 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:13:53 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/console.log" append="off"/>
Oct 20 13:13:53 user nova-compute[74701]:     </serial>
Oct 20 13:13:53 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:13:53 user nova-compute[74701]:     <video>
Oct 20 13:13:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:13:53 user nova-compute[74701]:     </video>
Oct 20 13:13:53 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:13:53 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:13:53 user nova-compute[74701]:     </rng>
Oct 20 13:13:53 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:13:53 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:13:53 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:13:53 user nova-compute[74701]:     </memballoon>
Oct 20 13:13:53 user nova-compute[74701]:   </devices>
Oct 20 13:13:53 user nova-compute[74701]: </domain>
Oct 20 13:13:53 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/KEWGZFGCLdFwPKV1pah4nx6zxk2pfe5LGo37B+gmjIBM0NERgCoGz1dUbwQukcpOrm0jVNFGkc1pxWH6BlZNotFKl8swMLaq8bkOXQbIUvmpXI5M6ow4RZFwsMWz4mg==',key_name='tempest-keypair-704380112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG os_vif [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c4c8977-8a47-54f4-81c8-514e14507616', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap119c01dd-e2, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap119c01dd-e2, col_values=(('qos', UUID('b52e1235-fb5c-4044-a221-b311c2bc6d6c')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap119c01dd-e2, col_values=(('external_ids', {'iface-id': '119c01dd-e22d-4d3d-a529-b1a16a01f9a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:a3:23', 'vm-uuid': '39db995b-5a3b-4077-97fc-81996bb88dd8'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:13:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:53 user nova-compute[74701]: INFO os_vif [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2')
Oct 20 13:13:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No VIF found with MAC fa:16:3e:17:a3:23, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updated VIF entry in instance network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-935875a4-95e1-4197-87ff-b60f9c0b5d5f req-b7ece056-e420-45e3-883b-507a243f1a3a service nova] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:55 user nova-compute[74701]: WARNING nova.compute.manager [req-f14d3d5c-b5f5-480e-9fe8-384ee597773c req-21d834a0-24dd-4c12-9a52-cc421dd9a2ef service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state building and task_state spawning.
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:13:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance spawned successfully.
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:13:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:13:58 user nova-compute[74701]: WARNING nova.compute.manager [req-9482baac-1637-4058-9527-89f7181bcfee req-71b06b40-e152-4256-944c-a32b3a78348b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state building and task_state spawning.
Oct 20 13:13:58 user nova-compute[74701]: INFO nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Took 6.45 seconds to spawn the instance on the hypervisor.
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:13:58 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:13:58 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:13:58 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:58 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=25.308013916015625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff699f1-3865-46cc-9cea-fb8a30b4f2ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:13:58 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bf8ab7-a1c6-4f2a-9b6d-b551e458cbe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48] added
Oct 20 13:13:58 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcda551-d558-4d0f-b63d-d14ed179dcd3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ee796-cb90-4ce7-aae2-0908016d3065]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfSbaQKD {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfSbaQKD" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef311e-61ae-406f-a789-962ca382396b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: INFO nova.compute.manager [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Took 7.63 seconds to build instance.
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfSbaQKD'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b36681ae-8058-4715-8555-730c49842e37 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.738s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc076cd6-0923-489e-b801-9f5c4c08c564]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 49cd00ef-639e-45d4-8681-4076ce232be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 39db995b-5a3b-4077-97fc-81996bb88dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8741bb-310f-41b5-b5c5-8d993e2d975e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:13:58 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:13:58 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:13:58 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:13:58 user nova-compute[74701]: 
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e345fc-766f-4b69-b488-41e44846c1b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]
Oct 20 13:13:58 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.
Oct 20 13:13:58 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[50845d74-083b-4b22-b94c-c75d341a031f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734c9a0-61d3-4737-9e95-e9866c220272]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:13:58 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:13:58 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa36aee-ee52-4a1c-bb26-61498476a715]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:13:58 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23065306536616433', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065306536616433', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lazy-loading 'flavor' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:13:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:13:59 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:13:59 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:13:59 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:13:59 user nova-compute[74701]:   <serial>8e19df4b-ad7a-48a4-9274-af74b3df7e48</serial>
Oct 20 13:13:59 user nova-compute[74701]: </disk>
Oct 20 13:13:59 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] No VIF found with MAC fa:16:3e:fb:87:0f, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4090c47f-7ddf-4603-8897-fad291d3a11d tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.115s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:14:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.utils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebee3ec-60cf-4023-867c-f435e9dba739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3788d9c-8b91-46e7-8668-ab39198917cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a707e-d85c-4928-8658-5d22c383d467]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e1152-a017-416e-b744-e1216626e376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:02 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:14:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c8fc7b-a188-461e-9a13-d3037e4ccbb8]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:14:02 user nova-compute[74701]: DEBUG os_brick.utils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:02 user nova-compute[74701]: INFO nova.compute.manager [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Swapping volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48 for 7558d962-2ca0-4707-9fc7-e899845a9d6f
Oct 20 13:14:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:14:12 user nova-compute[74701]: INFO nova.compute.claims [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Claim successful on node user
Oct 20 13:14:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:14:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.policy [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e7c09b687b54750aceb6e2d4ddce16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff75c095f4304b76b10c26ee8e8cc489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:14:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Creating image(s)
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "/opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "/opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "/opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.223s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk 1073741824" returned: 0 in 0.055s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Successfully created port: b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Cannot resize image /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Ensure instance console log exists: /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Successfully updated port: b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquired lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-changed-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Refreshing instance network info cache due to event network-changed-b951a7e9-683b-4528-bf80-88a93a136a02. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] Acquiring lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Updating instance_info_cache with network_info: [{"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Releasing lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Instance network_info: |[{"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] Acquired lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Refreshing network info cache for port b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Start _get_guest_xml network_info=[{"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:14:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070259435',display_name='tempest-ServersNegativeTestJSON-server-2070259435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070259435',id=20,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-w4y2z9dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:14Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=a15f5418-3bc2-4e67-9d41-1d3575677b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.objects.instance [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lazy-loading 'pci_devices' on Instance uuid a15f5418-3bc2-4e67-9d41-1d3575677b83 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:14:15 user nova-compute[74701]:   <uuid>a15f5418-3bc2-4e67-9d41-1d3575677b83</uuid>
Oct 20 13:14:15 user nova-compute[74701]:   <name>instance-00000014</name>
Oct 20 13:14:15 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:14:15 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:14:15 user nova-compute[74701]:   <metadata>
Oct 20 13:14:15 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:14:15 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:name>tempest-ServersNegativeTestJSON-server-2070259435</nova:name>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:14:15</nova:creationTime>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:14:15 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:14:15 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:owner>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:user uuid="5e7c09b687b54750aceb6e2d4ddce16f">tempest-ServersNegativeTestJSON-1044364652-project-member</nova:user>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:project uuid="ff75c095f4304b76b10c26ee8e8cc489">tempest-ServersNegativeTestJSON-1044364652</nova:project>
Oct 20 13:14:15 user nova-compute[74701]:       </nova:owner>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:14:15 user nova-compute[74701]:       <nova:ports>
Oct 20 13:14:15 user nova-compute[74701]:         <nova:port uuid="b951a7e9-683b-4528-bf80-88a93a136a02">
Oct 20 13:14:15 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:14:15 user nova-compute[74701]:         </nova:port>
Oct 20 13:14:15 user nova-compute[74701]:       </nova:ports>
Oct 20 13:14:15 user nova-compute[74701]:     </nova:instance>
Oct 20 13:14:15 user nova-compute[74701]:   </metadata>
Oct 20 13:14:15 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:14:15 user nova-compute[74701]:     <system>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="serial">a15f5418-3bc2-4e67-9d41-1d3575677b83</entry>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="uuid">a15f5418-3bc2-4e67-9d41-1d3575677b83</entry>
Oct 20 13:14:15 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:14:15 user nova-compute[74701]:     </system>
Oct 20 13:14:15 user nova-compute[74701]:   </sysinfo>
Oct 20 13:14:15 user nova-compute[74701]:   <os>
Oct 20 13:14:15 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:14:15 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:14:15 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:14:15 user nova-compute[74701]:   </os>
Oct 20 13:14:15 user nova-compute[74701]:   <features>
Oct 20 13:14:15 user nova-compute[74701]:     <acpi/>
Oct 20 13:14:15 user nova-compute[74701]:     <apic/>
Oct 20 13:14:15 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:14:15 user nova-compute[74701]:   </features>
Oct 20 13:14:15 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:14:15 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:14:15 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:14:15 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:14:15 user nova-compute[74701]:   </clock>
Oct 20 13:14:15 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:14:15 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:14:15 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:14:15 user nova-compute[74701]:   </cpu>
Oct 20 13:14:15 user nova-compute[74701]:   <devices>
Oct 20 13:14:15 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:14:15 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:14:15 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk"/>
Oct 20 13:14:15 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:14:15 user nova-compute[74701]:     </disk>
Oct 20 13:14:15 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:14:15 user nova-compute[74701]:       <mac address="fa:16:3e:18:11:a8"/>
Oct 20 13:14:15 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:15 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:14:15 user nova-compute[74701]:       <target dev="tapb951a7e9-68"/>
Oct 20 13:14:15 user nova-compute[74701]:     </interface>
Oct 20 13:14:15 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:14:15 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/console.log" append="off"/>
Oct 20 13:14:15 user nova-compute[74701]:     </serial>
Oct 20 13:14:15 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:14:15 user nova-compute[74701]:     <video>
Oct 20 13:14:15 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:15 user nova-compute[74701]:     </video>
Oct 20 13:14:15 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:14:15 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:14:15 user nova-compute[74701]:     </rng>
Oct 20 13:14:15 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:14:15 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:14:15 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:14:15 user nova-compute[74701]:     </memballoon>
Oct 20 13:14:15 user nova-compute[74701]:   </devices>
Oct 20 13:14:15 user nova-compute[74701]: </domain>
Oct 20 13:14:15 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070259435',display_name='tempest-ServersNegativeTestJSON-server-2070259435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070259435',id=20,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-w4y2z9dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:14Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=a15f5418-3bc2-4e67-9d41-1d3575677b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG os_vif [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '699b5a54-3d5a-5dff-80ed-91609cd1c1fc', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb951a7e9-68, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb951a7e9-68, col_values=(('qos', UUID('6118e90a-6521-47e2-b122-0bd7b9fcb528')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb951a7e9-68, col_values=(('external_ids', {'iface-id': 'b951a7e9-683b-4528-bf80-88a93a136a02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:11:a8', 'vm-uuid': 'a15f5418-3bc2-4e67-9d41-1d3575677b83'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:15 user nova-compute[74701]: INFO os_vif [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68')
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] No VIF found with MAC fa:16:3e:18:11:a8, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:14:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Updated VIF entry in instance network info cache for port b951a7e9-683b-4528-bf80-88a93a136a02. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Updating instance_info_cache with network_info: [{"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aef70501-7cba-4376-ae50-1d8cc0aaf86e req-7ce57e4a-28c9-4bfb-a5c6-99998f40a980 service nova] Releasing lock "refresh_cache-a15f5418-3bc2-4e67-9d41-1d3575677b83" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] No waiting events found dispatching network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:17 user nova-compute[74701]: WARNING nova.compute.manager [req-ca244465-d85d-4974-8ab9-2950d7972d69 req-1fec9f2e-78ff-4de9-bb1a-15e16673cc1f service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received unexpected event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 for instance with vm_state building and task_state spawning.
Oct 20 13:14:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] No waiting events found dispatching network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:19 user nova-compute[74701]: WARNING nova.compute.manager [req-4b60ac9c-88bd-4000-bb16-f19426674f95 req-9ea32282-1395-4ef6-8e73-b96c587632de service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received unexpected event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 for instance with vm_state building and task_state spawning.
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:14:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Instance spawned successfully.
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:19 user nova-compute[74701]: INFO nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 20 13:14:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:14:20 user nova-compute[74701]: INFO nova.compute.manager [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Took 7.22 seconds to build instance.
Oct 20 13:14:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-60d3c8ed-5774-4eff-9aba-7153684b5387 tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.361s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:14:25 user nova-compute[74701]: INFO nova.compute.claims [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Claim successful on node user
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:14:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.policy [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9189507d4d4f4faeb52d1f6b1fcb17d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0182e44f51fb425c8cd560e7a42da61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:14:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Creating image(s)
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "/opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "/opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "/opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f', 'serial': '7558d962-2ca0-4707-9fc7-e899845a9d6f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'serial'} {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:26 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:14:26 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:14:26 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab466bff-5be9-4a8d-8e26-e387723a4003]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:14:26 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a65747-ed8f-4db4-87d7-038510ce4724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f] added
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b439e6-56fe-43d2-9dd4-f5924890fb0a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7102d-85bb-43cb-a646-0efbceab195c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuinJNhm {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuinJNhm" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670e99d-d252-4b71-ba92-a7faed52074b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuinJNhm'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.248s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562363d-d609-49d4-b44b-bd5d7b831409]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk 1073741824" returned: 0 in 0.063s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88745d2-a41d-4844-b433-191b5457b93a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fce5d-3d4b-4b21-9748-eb9539eb615a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260]
Oct 20 13:14:26 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260] successful.
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[74608c44-ac41-4158-be1b-e2f47286a560]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94f4d6-78a0-4c3b-b403-47927d1ac174]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:26 user nova-compute[74701]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:26 user nova-compute[74701]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c1f72-07c4-4160-82ef-1c9f8e29c71a]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.219s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Successfully created port: fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Cannot resize image /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Ensure instance console log exists: /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Successfully updated port: fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing instance network info cache due to event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '26166306463636533', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166306463636533', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lazy-loading 'flavor' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Instance network_info: |[{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Start _get_guest_xml network_info=[{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:14:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-522447729',display_name='tempest-ServerActionsTestOtherA-server-522447729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-522447729',id=21,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-mkql2vhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'pci_devices' on Instance uuid 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:14:27 user nova-compute[74701]:   <uuid>08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a</uuid>
Oct 20 13:14:27 user nova-compute[74701]:   <name>instance-00000015</name>
Oct 20 13:14:27 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:14:27 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:14:27 user nova-compute[74701]:   <metadata>
Oct 20 13:14:27 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:14:27 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherA-server-522447729</nova:name>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:14:27</nova:creationTime>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:14:27 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:14:27 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:owner>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:user uuid="9189507d4d4f4faeb52d1f6b1fcb17d8">tempest-ServerActionsTestOtherA-1694438458-project-member</nova:user>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:project uuid="0182e44f51fb425c8cd560e7a42da61f">tempest-ServerActionsTestOtherA-1694438458</nova:project>
Oct 20 13:14:27 user nova-compute[74701]:       </nova:owner>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:14:27 user nova-compute[74701]:       <nova:ports>
Oct 20 13:14:27 user nova-compute[74701]:         <nova:port uuid="fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f">
Oct 20 13:14:27 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:14:27 user nova-compute[74701]:         </nova:port>
Oct 20 13:14:27 user nova-compute[74701]:       </nova:ports>
Oct 20 13:14:27 user nova-compute[74701]:     </nova:instance>
Oct 20 13:14:27 user nova-compute[74701]:   </metadata>
Oct 20 13:14:27 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:14:27 user nova-compute[74701]:     <system>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="serial">08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a</entry>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="uuid">08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a</entry>
Oct 20 13:14:27 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:14:27 user nova-compute[74701]:     </system>
Oct 20 13:14:27 user nova-compute[74701]:   </sysinfo>
Oct 20 13:14:27 user nova-compute[74701]:   <os>
Oct 20 13:14:27 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:14:27 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:14:27 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:14:27 user nova-compute[74701]:   </os>
Oct 20 13:14:27 user nova-compute[74701]:   <features>
Oct 20 13:14:27 user nova-compute[74701]:     <acpi/>
Oct 20 13:14:27 user nova-compute[74701]:     <apic/>
Oct 20 13:14:27 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:14:27 user nova-compute[74701]:   </features>
Oct 20 13:14:27 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:14:27 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:14:27 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:14:27 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:14:27 user nova-compute[74701]:   </clock>
Oct 20 13:14:27 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:14:27 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:14:27 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:14:27 user nova-compute[74701]:   </cpu>
Oct 20 13:14:27 user nova-compute[74701]:   <devices>
Oct 20 13:14:27 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:14:27 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:14:27 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk"/>
Oct 20 13:14:27 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:14:27 user nova-compute[74701]:     </disk>
Oct 20 13:14:27 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:14:27 user nova-compute[74701]:       <mac address="fa:16:3e:08:a4:ab"/>
Oct 20 13:14:27 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:27 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:14:27 user nova-compute[74701]:       <target dev="tapfddb50c3-5a"/>
Oct 20 13:14:27 user nova-compute[74701]:     </interface>
Oct 20 13:14:27 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:14:27 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/console.log" append="off"/>
Oct 20 13:14:27 user nova-compute[74701]:     </serial>
Oct 20 13:14:27 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:14:27 user nova-compute[74701]:     <video>
Oct 20 13:14:27 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:27 user nova-compute[74701]:     </video>
Oct 20 13:14:27 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:14:27 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:14:27 user nova-compute[74701]:     </rng>
Oct 20 13:14:27 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:14:27 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:14:27 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:14:27 user nova-compute[74701]:     </memballoon>
Oct 20 13:14:27 user nova-compute[74701]:   </devices>
Oct 20 13:14:27 user nova-compute[74701]: </domain>
Oct 20 13:14:27 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-522447729',display_name='tempest-ServerActionsTestOtherA-server-522447729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-522447729',id=21,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-mkql2vhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG os_vif [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb36b85e-e1e0-5695-a6f4-680292c50c32', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfddb50c3-5a, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfddb50c3-5a, col_values=(('qos', UUID('022a9c6e-3358-4a1f-ac1f-0ab040729e0c')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfddb50c3-5a, col_values=(('external_ids', {'iface-id': 'fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:a4:ab', 'vm-uuid': '08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:27 user nova-compute[74701]: INFO os_vif [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a')
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No VIF found with MAC fa:16:3e:08:a4:ab, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:14:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated VIF entry in instance network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ee6ee6f3-eadb-416b-9d54-31f9eed8bced req-882eaf98-f011-4429-b360-2cbb20e43bbf service nova] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 243269632 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 417333248 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 538968064 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] No waiting events found dispatching network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:30 user nova-compute[74701]: WARNING nova.compute.manager [req-242ec889-4099-45e1-9992-8cc18e5b1920 req-3413e435-30f9-42ec-a9c1-87a2cb7acbcd service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received unexpected event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f for instance with vm_state building and task_state spawning.
Oct 20 13:14:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 683671552 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 837812224 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 974127104 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 1068498944 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:14:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Instance spawned successfully.
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:32 user nova-compute[74701]: INFO nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Took 6.64 seconds to spawn the instance on the hypervisor.
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] No waiting events found dispatching network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:32 user nova-compute[74701]: WARNING nova.compute.manager [req-96278f55-5b72-48e8-9833-0ef27d274ac0 req-419477ed-a644-4ae9-901a-1ba263e4aaa6 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received unexpected event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f for instance with vm_state building and task_state spawning.
Oct 20 13:14:32 user nova-compute[74701]: INFO nova.compute.manager [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Took 7.64 seconds to build instance.
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-43a81271-6085-454c-8afd-195c1567e66e tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.751s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948d877-c797-4f04-aade-5e6268eb95e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:14:32 user nova-compute[74701]: No targets found.
Oct 20 13:14:32 user nova-compute[74701]: iSNS:
Oct 20 13:14:32 user nova-compute[74701]: No targets found.
Oct 20 13:14:32 user nova-compute[74701]: STATIC:
Oct 20 13:14:32 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48
Oct 20 13:14:32 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:14:32 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:14:32 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f
Oct 20 13:14:32 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:14:32 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:14:32 user nova-compute[74701]: FIRMWARE:
Oct 20 13:14:32 user nova-compute[74701]: No targets found.
Oct 20 13:14:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:14:32 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:14:32 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f6fd0e-7d27-4e31-8cc1-a7b1cb2e389a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b02ce-fbf1-411a-a456-51b976be0717]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:32 user nova-compute[74701]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:32 user nova-compute[74701]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc7dd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e4a4f-d0e2-47b1-9d78-9b14e22e94df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab63a53-577b-473b-9cb9-2e203d7a31b7]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b34414-e740-4041-8f0a-2548add475b4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092d908-9837-4ef9-a10f-578e3660e2ac]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5de2ec-c33f-49f7-8eea-1c8970bac93f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f619a57-4ccd-4644-9990-96928e84e114]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]
Oct 20 13:14:33 user nova-compute[74701]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.
Oct 20 13:14:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a779b-fe82-49a3-9e43-578e5b628f69]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== disconnect_volume: return (331ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f', 'serial'} {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: removing Cinder connection for volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48 {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 13:14:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: Updating volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QuinJNhm", "auth_password": "8Qamik6YA5uPZN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "7558d962-2ca0-4707-9fc7-e899845a9d6f"}, "status": "reserved", "instance": "49cd00ef-639e-45d4-8681-4076ce232be8", "attached_at": "", "detached_at": "", "volume_id": "7558d962-2ca0-4707-9fc7-e899845a9d6f", "serial": "7558d962-2ca0-4707-9fc7-e899845a9d6f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f', 'no_device': None, 'attachment_id': '4965a65c-97ea-4262-aae6-111a452994c6'} {{(pid=74701) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 13:14:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9817022e-2741-4c88-a140-a29b05ada9da tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.235s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:14:35 user nova-compute[74701]: INFO nova.compute.claims [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Claim successful on node user
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f63971-8f3d-404e-9c69-56a251e73e56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[487aad17-9e47-428d-bd5b-1aa46b865384]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7637d-3ecf-409d-b5f2-a1156f51982b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d927688-69a0-41aa-a73b-c0901637441f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:36 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:14:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5edcdad-c4bc-4c8f-82c7-1c06db992d44]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG os_brick.utils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:14:36 user nova-compute[74701]: INFO nova.compute.manager [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Swapping volume 7558d962-2ca0-4707-9fc7-e899845a9d6f for 8e19df4b-ad7a-48a4-9274-af74b3df7e48
Oct 20 13:14:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:14:36 user nova-compute[74701]: DEBUG nova.policy [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '751a8755f9774b1da2e71623164c40b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed52bceb45147ceb782e49acf3a9d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:14:36 user nova-compute[74701]: INFO nova.virt.block_device [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Booting with blank volume at /dev/vda
Oct 20 13:14:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Successfully created port: ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:14:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Successfully updated port: ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-changed-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Refreshing instance network info cache due to event network-changed-ef878f89-a7a8-42aa-8e95-d0f07446c226. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance network_info: |[{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Refreshing network info cache for port ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updated VIF entry in instance network info cache for port ef878f89-a7a8-42aa-8e95-d0f07446c226. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c876480b-9fc7-4e96-97ae-53da7f6404d0 req-bb259fae-dee0-45f3-9345-e42fd8adc4e5 service nova] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:43 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:14:43 user nova-compute[74701]: INFO nova.compute.claims [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Claim successful on node user
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:14:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.policy [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5a2fb1012774de08b84f6593eae8073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e48ad264d74341a6ee4c5d420385d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:14:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Creating image(s)
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:14:45 user nova-compute[74701]: INFO nova.compute.claims [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Claim successful on node user
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.238s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk 1073741824" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Successfully created port: 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.862s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Cannot resize image /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Ensure instance console log exists: /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:14:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:14:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.policy [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fe2bdad98cf4bdfbcb30ceca45384a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a261f1898367489881befeab0d825c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:14:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Creating image(s)
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "/opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "/opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "/opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Successfully updated port: 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing instance network info cache due to event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk 1073741824" returned: 0 in 0.052s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Successfully created port: 2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.238s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance network_info: |[{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start _get_guest_xml network_info=[{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:14:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-137752104',display_name='tempest-ServerRescueNegativeTestJSON-server-137752104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-137752104',id=23,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6MyZeHF4TZQ95c9gGZafULpwah2Iu6lvsYuO+mdk/qOBWWK1mxLCvBr/3EFUp97kcu/X57uaE51+1q+RKkvWqujl8tjbpHTzQ94H6HfvS6hcaUagYQmFny1qLvJ6dvpg==',key_name='tempest-keypair-869580081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-qxa6mm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d15383e1-cb58-4069-82ae-d1ceaa1a2e7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:14:47 user nova-compute[74701]:   <uuid>d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</uuid>
Oct 20 13:14:47 user nova-compute[74701]:   <name>instance-00000017</name>
Oct 20 13:14:47 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:14:47 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:14:47 user nova-compute[74701]:   <metadata>
Oct 20 13:14:47 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:14:47 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-137752104</nova:name>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:14:47</nova:creationTime>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:14:47 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:14:47 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:owner>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:14:47 user nova-compute[74701]:       </nova:owner>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:14:47 user nova-compute[74701]:       <nova:ports>
Oct 20 13:14:47 user nova-compute[74701]:         <nova:port uuid="0bf1252a-3258-4278-80d1-bff6c2aad9cb">
Oct 20 13:14:47 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:14:47 user nova-compute[74701]:         </nova:port>
Oct 20 13:14:47 user nova-compute[74701]:       </nova:ports>
Oct 20 13:14:47 user nova-compute[74701]:     </nova:instance>
Oct 20 13:14:47 user nova-compute[74701]:   </metadata>
Oct 20 13:14:47 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:14:47 user nova-compute[74701]:     <system>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="serial">d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</entry>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="uuid">d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</entry>
Oct 20 13:14:47 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:14:47 user nova-compute[74701]:     </system>
Oct 20 13:14:47 user nova-compute[74701]:   </sysinfo>
Oct 20 13:14:47 user nova-compute[74701]:   <os>
Oct 20 13:14:47 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:14:47 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:14:47 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:14:47 user nova-compute[74701]:   </os>
Oct 20 13:14:47 user nova-compute[74701]:   <features>
Oct 20 13:14:47 user nova-compute[74701]:     <acpi/>
Oct 20 13:14:47 user nova-compute[74701]:     <apic/>
Oct 20 13:14:47 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:14:47 user nova-compute[74701]:   </features>
Oct 20 13:14:47 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:14:47 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:14:47 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:14:47 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:14:47 user nova-compute[74701]:   </clock>
Oct 20 13:14:47 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:14:47 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:14:47 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:14:47 user nova-compute[74701]:   </cpu>
Oct 20 13:14:47 user nova-compute[74701]:   <devices>
Oct 20 13:14:47 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:14:47 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:14:47 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk"/>
Oct 20 13:14:47 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:14:47 user nova-compute[74701]:     </disk>
Oct 20 13:14:47 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:14:47 user nova-compute[74701]:       <mac address="fa:16:3e:df:20:71"/>
Oct 20 13:14:47 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:47 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:14:47 user nova-compute[74701]:       <target dev="tap0bf1252a-32"/>
Oct 20 13:14:47 user nova-compute[74701]:     </interface>
Oct 20 13:14:47 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:14:47 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/console.log" append="off"/>
Oct 20 13:14:47 user nova-compute[74701]:     </serial>
Oct 20 13:14:47 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:14:47 user nova-compute[74701]:     <video>
Oct 20 13:14:47 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:47 user nova-compute[74701]:     </video>
Oct 20 13:14:47 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:14:47 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:14:47 user nova-compute[74701]:     </rng>
Oct 20 13:14:47 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:14:47 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:14:47 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:14:47 user nova-compute[74701]:     </memballoon>
Oct 20 13:14:47 user nova-compute[74701]:   </devices>
Oct 20 13:14:47 user nova-compute[74701]: </domain>
Oct 20 13:14:47 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-137752104',display_name='tempest-ServerRescueNegativeTestJSON-server-137752104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-137752104',id=23,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6MyZeHF4TZQ95c9gGZafULpwah2Iu6lvsYuO+mdk/qOBWWK1mxLCvBr/3EFUp97kcu/X57uaE51+1q+RKkvWqujl8tjbpHTzQ94H6HfvS6hcaUagYQmFny1qLvJ6dvpg==',key_name='tempest-keypair-869580081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-qxa6mm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d15383e1-cb58-4069-82ae-d1ceaa1a2e7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_vif [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11d663d5-ed8c-5d77-9284-3887e7637c72', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Cannot resize image /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Ensure instance console log exists: /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bf1252a-32, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bf1252a-32, col_values=(('qos', UUID('97a2c90d-1822-47fc-8b30-2afd9b97dbf3')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bf1252a-32, col_values=(('external_ids', {'iface-id': '0bf1252a-3258-4278-80d1-bff6c2aad9cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:20:71', 'vm-uuid': 'd15383e1-cb58-4069-82ae-d1ceaa1a2e7f'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:47 user nova-compute[74701]: INFO os_vif [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32')
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:df:20:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updated VIF entry in instance network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.utils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2de7051d-37bc-4b6b-8baf-47475525c700 req-56d5b360-0e3e-41d1-ba61-0884f571be4f service nova] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99189b07-f5f0-4bb4-acc4-5f5506679686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e552a-d931-4a3d-b594-6ef1004a6d00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[763242e3-8196-4a5d-9695-0837dcef800e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-changed-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Refreshing instance network info cache due to event network-changed-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Refreshing network info cache for port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d297d4-98df-48ae-91d2-96d98a5bb761]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:14:47 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:14:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4698dfa4-a1a9-4929-a216-9404e30cd5d8]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG os_brick.utils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:47 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating existing volume attachment record: 1fd47353-2f09-47f2-936a-8d851f4ca6e3 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Successfully updated port: 2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquired lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-changed-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Refreshing instance network info cache due to event network-changed-2ebb6478-4dbc-41a9-8901-917b4cae213c. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] Acquiring lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updated VIF entry in instance network info cache for port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9407f380-5310-46cf-87ed-cf2d1a6e5898 req-700c2260-3db2-443e-845d-32b66726f5cf service nova] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Updating instance_info_cache with network_info: [{"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Releasing lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Instance network_info: |[{"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] Acquired lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.neutron [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Refreshing network info cache for port 2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Start _get_guest_xml network_info=[{"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:14:48 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:48 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122873609',display_name='tempest-VolumesActionsTest-instance-2122873609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122873609',id=24,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a261f1898367489881befeab0d825c59',ramdisk_id='',reservation_id='r-g6go8n0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1549387927',owner_user_name='tempest-VolumesActionsTest-1549387927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:46Z,user_data=None,user_id='5fe2bdad98cf4bdfbcb30ceca45384a0',uuid=c29487d5-c955-40a5-b9f8-15b539bf19f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converting VIF {"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lazy-loading 'pci_devices' on Instance uuid c29487d5-c955-40a5-b9f8-15b539bf19f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:14:48 user nova-compute[74701]:   <uuid>c29487d5-c955-40a5-b9f8-15b539bf19f4</uuid>
Oct 20 13:14:48 user nova-compute[74701]:   <name>instance-00000018</name>
Oct 20 13:14:48 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:14:48 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:14:48 user nova-compute[74701]:   <metadata>
Oct 20 13:14:48 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:14:48 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:name>tempest-VolumesActionsTest-instance-2122873609</nova:name>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:14:48</nova:creationTime>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:14:48 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:14:48 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:owner>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:user uuid="5fe2bdad98cf4bdfbcb30ceca45384a0">tempest-VolumesActionsTest-1549387927-project-member</nova:user>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:project uuid="a261f1898367489881befeab0d825c59">tempest-VolumesActionsTest-1549387927</nova:project>
Oct 20 13:14:48 user nova-compute[74701]:       </nova:owner>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:14:48 user nova-compute[74701]:       <nova:ports>
Oct 20 13:14:48 user nova-compute[74701]:         <nova:port uuid="2ebb6478-4dbc-41a9-8901-917b4cae213c">
Oct 20 13:14:48 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 13:14:48 user nova-compute[74701]:         </nova:port>
Oct 20 13:14:48 user nova-compute[74701]:       </nova:ports>
Oct 20 13:14:48 user nova-compute[74701]:     </nova:instance>
Oct 20 13:14:48 user nova-compute[74701]:   </metadata>
Oct 20 13:14:48 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:14:48 user nova-compute[74701]:     <system>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="serial">c29487d5-c955-40a5-b9f8-15b539bf19f4</entry>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="uuid">c29487d5-c955-40a5-b9f8-15b539bf19f4</entry>
Oct 20 13:14:48 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:14:48 user nova-compute[74701]:     </system>
Oct 20 13:14:48 user nova-compute[74701]:   </sysinfo>
Oct 20 13:14:48 user nova-compute[74701]:   <os>
Oct 20 13:14:48 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:14:48 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:14:48 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:14:48 user nova-compute[74701]:   </os>
Oct 20 13:14:48 user nova-compute[74701]:   <features>
Oct 20 13:14:48 user nova-compute[74701]:     <acpi/>
Oct 20 13:14:48 user nova-compute[74701]:     <apic/>
Oct 20 13:14:48 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:14:48 user nova-compute[74701]:   </features>
Oct 20 13:14:48 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:14:48 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:14:48 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:14:48 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:14:48 user nova-compute[74701]:   </clock>
Oct 20 13:14:48 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:14:48 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:14:48 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:14:48 user nova-compute[74701]:   </cpu>
Oct 20 13:14:48 user nova-compute[74701]:   <devices>
Oct 20 13:14:48 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:14:48 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:14:48 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk"/>
Oct 20 13:14:48 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:14:48 user nova-compute[74701]:     </disk>
Oct 20 13:14:48 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:14:48 user nova-compute[74701]:       <mac address="fa:16:3e:a5:ec:98"/>
Oct 20 13:14:48 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:48 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:14:48 user nova-compute[74701]:       <target dev="tap2ebb6478-4d"/>
Oct 20 13:14:48 user nova-compute[74701]:     </interface>
Oct 20 13:14:48 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:14:48 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/console.log" append="off"/>
Oct 20 13:14:48 user nova-compute[74701]:     </serial>
Oct 20 13:14:48 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:14:48 user nova-compute[74701]:     <video>
Oct 20 13:14:48 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:14:48 user nova-compute[74701]:     </video>
Oct 20 13:14:48 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:14:48 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:14:48 user nova-compute[74701]:     </rng>
Oct 20 13:14:48 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:14:48 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:14:48 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:14:48 user nova-compute[74701]:     </memballoon>
Oct 20 13:14:48 user nova-compute[74701]:   </devices>
Oct 20 13:14:48 user nova-compute[74701]: </domain>
Oct 20 13:14:48 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122873609',display_name='tempest-VolumesActionsTest-instance-2122873609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122873609',id=24,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a261f1898367489881befeab0d825c59',ramdisk_id='',reservation_id='r-g6go8n0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1549387927',owner_user_name='tempest-VolumesActionsTest-1549387927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:46Z,user_data=None,user_id='5fe2bdad98cf4bdfbcb30ceca45384a0',uuid=c29487d5-c955-40a5-b9f8-15b539bf19f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converting VIF {"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG os_vif [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57472111-0255-51bb-b900-a821042bd614', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ebb6478-4d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ebb6478-4d, col_values=(('qos', UUID('b0bb58e7-8297-440c-8f8f-93c706dd5bd4')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ebb6478-4d, col_values=(('external_ids', {'iface-id': '2ebb6478-4dbc-41a9-8901-917b4cae213c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:ec:98', 'vm-uuid': 'c29487d5-c955-40a5-b9f8-15b539bf19f4'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:48 user nova-compute[74701]: INFO os_vif [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d')
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:14:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] No VIF found with MAC fa:16:3e:a5:ec:98, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG nova.network.neutron [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Updated VIF entry in instance network info cache for port 2ebb6478-4dbc-41a9-8901-917b4cae213c. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG nova.network.neutron [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Updating instance_info_cache with network_info: [{"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35bafd7d-9900-434a-b441-20d03bb09e8d req-cd7d73d0-41c9-46e9-917d-301d74fa9cd1 service nova] Releasing lock "refresh_cache-c29487d5-c955-40a5-b9f8-15b539bf19f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:49 user nova-compute[74701]: WARNING nova.compute.manager [req-6739d929-762d-49c5-83c2-c0a1415df0b3 req-9c7052bd-9851-4e26-b9e8-79578d81f06b service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state building and task_state spawning.
Oct 20 13:14:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] No waiting events found dispatching network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:50 user nova-compute[74701]: WARNING nova.compute.manager [req-d0de5d71-3b15-4b33-90ff-d4c4fc30dc40 req-fc412f83-7ae1-4f99-8d19-795c6edde222 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received unexpected event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c for instance with vm_state building and task_state spawning.
Oct 20 13:14:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:51 user nova-compute[74701]: WARNING nova.compute.manager [req-56d369f5-1de9-4ef5-8442-2a63c2faedb0 req-158d0d6a-04a3-4262-929e-51820d8bcc8d service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state building and task_state spawning.
Oct 20 13:14:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:14:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance spawned successfully.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: INFO nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Took 7.59 seconds to spawn the instance on the hypervisor.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:14:52 user nova-compute[74701]: INFO nova.compute.manager [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Took 8.59 seconds to build instance.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abe57df9-b404-430f-8cb0-4da7ed9b6ea3 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.718s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] No waiting events found dispatching network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:14:52 user nova-compute[74701]: WARNING nova.compute.manager [req-8b3c3de5-2589-448a-9d60-1bd9101de385 req-7662b186-f7fc-480e-a800-8eb98a753a0f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received unexpected event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c for instance with vm_state building and task_state spawning.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:14:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Instance spawned successfully.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:14:52 user nova-compute[74701]: INFO nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Took 6.84 seconds to spawn the instance on the hypervisor.
Oct 20 13:14:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:14:53 user nova-compute[74701]: INFO nova.compute.manager [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Took 8.13 seconds to build instance.
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-80cf6fed-53b5-4c91-8035-91a75b5dcf38 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.304s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:14:53 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:14:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:55 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'serial': '8e19df4b-ad7a-48a4-9274-af74b3df7e48'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f'}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f', 'serial'} {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:14:56 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:14:56 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:14:56 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d6a26-9a15-4f87-a2af-306fb0d8f923]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:14:56 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[79945f97-2b2a-4ae6-bc49-445891e8b06a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48] added
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c0e38-3b01-4ea7-a81b-e14859008608]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c78da6-7112-40af-83ee-1c86d205e3f2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfSbaQKD {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfSbaQKD" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f799452-da6e-48ce-80df-a730f61c790f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfSbaQKD'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[23962bc6-d119-4de4-8f84-b37a4d81a5a9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d02676-b725-4142-a7fa-87b72eb67c6c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[857bc6e7-5963-4b86-badd-2771e1c05614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]
Oct 20 13:14:56 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebf16f4-8cc9-4764-ab1e-ea827aca05fd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c03392-4d0f-4154-93ef-70cc16954380]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:56 user nova-compute[74701]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:14:56 user nova-compute[74701]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:14:56 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78f8f9-f42e-4086-b5b3-915b08e3aec3]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23065306536616433', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065306536616433', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lazy-loading 'flavor' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 272629760 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 399507456 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:14:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:15:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 757071872 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:15:01 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:01 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.20572280883789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 49cd00ef-639e-45d4-8681-4076ce232be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 39db995b-5a3b-4077-97fc-81996bb88dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a15f5418-3bc2-4e67-9d41-1d3575677b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c29487d5-c955-40a5-b9f8-15b539bf19f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:15:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 871366656 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 1012924416 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.114s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuinJNhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '7558d962-2ca0-4707-9fc7-e899845a9d6f'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:15:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c66bf4-5080-48c7-b96c-222338bbcc0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:15:03 user nova-compute[74701]: No targets found.
Oct 20 13:15:03 user nova-compute[74701]: iSNS:
Oct 20 13:15:03 user nova-compute[74701]: No targets found.
Oct 20 13:15:03 user nova-compute[74701]: STATIC:
Oct 20 13:15:03 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48
Oct 20 13:15:03 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:15:03 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:15:03 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f
Oct 20 13:15:03 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:15:03 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:15:03 user nova-compute[74701]: FIRMWARE:
Oct 20 13:15:03 user nova-compute[74701]: No targets found.
Oct 20 13:15:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:15:03 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:15:03 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c673c-eb34-4ce0-ba4c-62ac9fa3dc57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1984b535-7fd8-4c30-b16d-dae9ae051b95]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:15:03 user nova-compute[74701]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f (non-flash)
Oct 20 13:15:03 user nova-compute[74701]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e063bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c330b-9f71-491f-951b-d24cd0e37c6a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed91f6-f078-4527-8b81-2065a47ba3fb]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33dcac-0dfa-4d1c-a488-84974c167439]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1588f26-f972-4865-bb41-84a7bf2d634f]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[63489156-486f-484c-bb7f-86f6e07fa013]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a865f928-f9fc-4ef0-8831-ca2de3604bc9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260]
Oct 20 13:15:03 user nova-compute[74701]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f, portal: 172.16.0.220,3260] successful.
Oct 20 13:15:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7558d962-2ca0-4707-9fc7-e899845a9d6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98891873-ba55-4742-bf20-50cf76eefaed]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] <== disconnect_volume: return (307ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '49cd00ef-639e-45d4-8681-4076ce232be8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'serial'} {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: removing Cinder connection for volume 7558d962-2ca0-4707-9fc7-e899845a9d6f {{(pid=74701) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:15:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] swap_volume: Updating volume 7558d962-2ca0-4707-9fc7-e899845a9d6f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IfSbaQKD", "auth_password": "qDcKR0XONMuj2k", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "8e19df4b-ad7a-48a4-9274-af74b3df7e48"}, "status": "reserved", "instance": "49cd00ef-639e-45d4-8681-4076ce232be8", "attached_at": "", "detached_at": "", "volume_id": "8e19df4b-ad7a-48a4-9274-af74b3df7e48", "serial": "8e19df4b-ad7a-48a4-9274-af74b3df7e48"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'no_device': None, 'attachment_id': '9024d9a7-f323-4b1b-998c-44c3512d5e52'} {{(pid=74701) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 13:15:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a653d889-fb5e-4da8-b77d-d634f3f5577a tempest-TestVolumeSwap-1189240150 tempest-TestVolumeSwap-1189240150-project-admin] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 28.723s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:05 user nova-compute[74701]: INFO nova.compute.manager [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Detaching volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48
Oct 20 13:15:06 user nova-compute[74701]: INFO nova.virt.block_device [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Attempting to driver detach volume 8e19df4b-ad7a-48a4-9274-af74b3df7e48 from mountpoint /dev/vdb
Oct 20 13:15:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Attempting to detach device vdb from instance 49cd00ef-639e-45d4-8681-4076ce232be8 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:15:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:15:06 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:06 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:15:06 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:15:06 user nova-compute[74701]:   <serial>8e19df4b-ad7a-48a4-9274-af74b3df7e48</serial>
Oct 20 13:15:06 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:15:06 user nova-compute[74701]: </disk>
Oct 20 13:15:06 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:15:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Successfully detached device vdb from instance 49cd00ef-639e-45d4-8681-4076ce232be8 from the persistent domain config.
Oct 20 13:15:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49cd00ef-639e-45d4-8681-4076ce232be8 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:15:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:15:06 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:06 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:15:06 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:15:06 user nova-compute[74701]:   <serial>8e19df4b-ad7a-48a4-9274-af74b3df7e48</serial>
Oct 20 13:15:06 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:15:06 user nova-compute[74701]: </disk>
Oct 20 13:15:06 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:15:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:15:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:15:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Creating image(s)
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Ensure instance console log exists: /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start _get_guest_xml network_info=[{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4053c98d-7a1e-4019-84b5-0ae71af9ff95', 'attached_at': '', 'detached_at': '', 'volume_id': '5321679c-49d9-4caf-99ec-5af541fd2ac5', 'serial': '5321679c-49d9-4caf-99ec-5af541fd2ac5'}, 'attachment_id': '1fd47353-2f09-47f2-936a-8d851f4ca6e3', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:15:09 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:09 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:15:09 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:09 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:09 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36963a9-e411-43a7-a98c-a6d2494ebe3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:15:09 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451e2a1-fd7a-4e17-8da2-b0c29bc3aeb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5] added
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1d5e5-9f6d-4db0-bb1e-18e20898d4cd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408d974-7599-49e8-8404-3400654da509]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVPdbkAG {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVPdbkAG" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77912f10-e258-4e67-a235-8b1558d2fbd8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVPdbkAG'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[04702b00-03af-4fb7-bb25-b6c23f372521]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d495f1c-dada-4de3-9520-bbf2a8a2b82b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8b564-bb48-4f12-bbf4-073e0346c98d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260]
Oct 20 13:15:09 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260] successful.
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b299f4-2e31-4177-aaa9-538f8ef0ddcd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470e3a9-194b-45fa-bd79-bf2272f5c701]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf2fcc-51ac-421d-a8ec-34228f31b11d]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26263303866323237', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263303866323237', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-104078597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-104078597',id=22,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-8p43it6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:37Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=4053c98d-7a1e-4019-84b5-0ae71af9ff95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:15:10 user nova-compute[74701]:   <uuid>4053c98d-7a1e-4019-84b5-0ae71af9ff95</uuid>
Oct 20 13:15:10 user nova-compute[74701]:   <name>instance-00000016</name>
Oct 20 13:15:10 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:15:10 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:15:10 user nova-compute[74701]:   <metadata>
Oct 20 13:15:10 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:15:10 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-104078597</nova:name>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:15:09</nova:creationTime>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:15:10 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:15:10 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:owner>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:15:10 user nova-compute[74701]:       </nova:owner>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:15:10 user nova-compute[74701]:       <nova:ports>
Oct 20 13:15:10 user nova-compute[74701]:         <nova:port uuid="ef878f89-a7a8-42aa-8e95-d0f07446c226">
Oct 20 13:15:10 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:15:10 user nova-compute[74701]:         </nova:port>
Oct 20 13:15:10 user nova-compute[74701]:       </nova:ports>
Oct 20 13:15:10 user nova-compute[74701]:     </nova:instance>
Oct 20 13:15:10 user nova-compute[74701]:   </metadata>
Oct 20 13:15:10 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:15:10 user nova-compute[74701]:     <system>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="serial">4053c98d-7a1e-4019-84b5-0ae71af9ff95</entry>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="uuid">4053c98d-7a1e-4019-84b5-0ae71af9ff95</entry>
Oct 20 13:15:10 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:15:10 user nova-compute[74701]:     </system>
Oct 20 13:15:10 user nova-compute[74701]:   </sysinfo>
Oct 20 13:15:10 user nova-compute[74701]:   <os>
Oct 20 13:15:10 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:15:10 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:15:10 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:15:10 user nova-compute[74701]:   </os>
Oct 20 13:15:10 user nova-compute[74701]:   <features>
Oct 20 13:15:10 user nova-compute[74701]:     <acpi/>
Oct 20 13:15:10 user nova-compute[74701]:     <apic/>
Oct 20 13:15:10 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:15:10 user nova-compute[74701]:   </features>
Oct 20 13:15:10 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:15:10 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:15:10 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:15:10 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:15:10 user nova-compute[74701]:   </clock>
Oct 20 13:15:10 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:15:10 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:15:10 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:15:10 user nova-compute[74701]:   </cpu>
Oct 20 13:15:10 user nova-compute[74701]:   <devices>
Oct 20 13:15:10 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:15:10 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:10 user nova-compute[74701]:       <source dev="/dev/sdc"/>
Oct 20 13:15:10 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:15:10 user nova-compute[74701]:       <serial>5321679c-49d9-4caf-99ec-5af541fd2ac5</serial>
Oct 20 13:15:10 user nova-compute[74701]:     </disk>
Oct 20 13:15:10 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:15:10 user nova-compute[74701]:       <mac address="fa:16:3e:16:c4:94"/>
Oct 20 13:15:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:15:10 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:15:10 user nova-compute[74701]:       <target dev="tapef878f89-a7"/>
Oct 20 13:15:10 user nova-compute[74701]:     </interface>
Oct 20 13:15:10 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:15:10 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/console.log" append="off"/>
Oct 20 13:15:10 user nova-compute[74701]:     </serial>
Oct 20 13:15:10 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:15:10 user nova-compute[74701]:     <video>
Oct 20 13:15:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:15:10 user nova-compute[74701]:     </video>
Oct 20 13:15:10 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:15:10 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:15:10 user nova-compute[74701]:     </rng>
Oct 20 13:15:10 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:15:10 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:15:10 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:15:10 user nova-compute[74701]:     </memballoon>
Oct 20 13:15:10 user nova-compute[74701]:   </devices>
Oct 20 13:15:10 user nova-compute[74701]: </domain>
Oct 20 13:15:10 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-104078597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-104078597',id=22,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-8p43it6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:37Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=4053c98d-7a1e-4019-84b5-0ae71af9ff95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG os_vif [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a442ca41-b7a0-569a-bfd0-293606ecc92d', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef878f89-a7, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef878f89-a7, col_values=(('qos', UUID('0a188e37-bdc8-40e8-ad2f-570217560c94')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef878f89-a7, col_values=(('external_ids', {'iface-id': 'ef878f89-a7a8-42aa-8e95-d0f07446c226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:c4:94', 'vm-uuid': '4053c98d-7a1e-4019-84b5-0ae71af9ff95'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:10 user nova-compute[74701]: INFO os_vif [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7')
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:15:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:16:c4:94, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:15:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:12 user nova-compute[74701]: WARNING nova.compute.manager [req-4240811a-1c23-4ef3-b5da-dfbaf57c9861 req-d4e54298-0291-4027-883d-7872e8a69b99 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state building and task_state spawning.
Oct 20 13:15:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:15:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance spawned successfully.
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:14 user nova-compute[74701]: WARNING nova.compute.manager [req-de076825-7672-48b9-a4dd-dae21db69435 req-249dabee-8f05-4fb2-9bb7-d0dc7a45e4db service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state building and task_state spawning.
Oct 20 13:15:14 user nova-compute[74701]: INFO nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 20 13:15:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:15:14 user nova-compute[74701]: INFO nova.compute.manager [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Took 39.30 seconds to build instance.
Oct 20 13:15:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5446cc85-c585-4083-8430-7dd2a344ed66 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.480s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-changed-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Refreshing instance network info cache due to event network-changed-377c2851-f2c8-4169-9d10-11543a0254ec. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] Acquiring lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] Acquired lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:19 user nova-compute[74701]: DEBUG nova.network.neutron [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Refreshing network info cache for port 377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:15:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updated VIF entry in instance network info cache for port 377c2851-f2c8-4169-9d10-11543a0254ec. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:15:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updating instance_info_cache with network_info: [{"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6aa2c534-e1f2-4949-a249-48bc65f94f51 req-77f5ce65-1f79-49a1-aa52-99aab988633d service nova] Releasing lock "refresh_cache-b8ca3042-e49a-4ae4-83f3-4e3512d39a86" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:25 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:26 user nova-compute[74701]: INFO nova.compute.manager [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Attaching volume b2629ced-a310-4182-a5ca-b27afb50a6a0 to /dev/vdb
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.utils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8329e4-0d47-4c58-af84-da578d9059a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9595d83e-97b4-40a9-80a6-ee8a079f8be6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd5d06-764a-4e7d-bda8-851c9f15436f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dc002c-5585-48a2-88c3-2d9378370032]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:15:26 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e6e156-f667-4d14-b783-c7153cef301a]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.utils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updating existing volume attachment record: e6c31d48-ee82-4f71-9b7e-938f7e3d4fc3 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:26 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49cd00ef-639e-45d4-8681-4076ce232be8 is timed out.
Oct 20 13:15:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Successfully detached device vdb from instance 49cd00ef-639e-45d4-8681-4076ce232be8 from the live domain config.
Oct 20 13:15:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfSbaQKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '8e19df4b-ad7a-48a4-9274-af74b3df7e48'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:15:26 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c32ec-7107-498c-8ce0-7f9c1d19d8ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:15:26 user nova-compute[74701]: No targets found.
Oct 20 13:15:26 user nova-compute[74701]: iSNS:
Oct 20 13:15:26 user nova-compute[74701]: No targets found.
Oct 20 13:15:26 user nova-compute[74701]: STATIC:
Oct 20 13:15:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:15:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:15:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:15:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48
Oct 20 13:15:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:15:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:15:26 user nova-compute[74701]: FIRMWARE:
Oct 20 13:15:26 user nova-compute[74701]: No targets found.
Oct 20 13:15:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:15:26 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:15:26 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[858bb5e6-f93b-4a48-a04f-1ab10857e682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be3ff2-e4d1-4934-b56c-a5f91e1134f5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:26 user nova-compute[74701]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 (non-flash)
Oct 20 13:15:26 user nova-compute[74701]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0189d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1289e7d7-0ec8-45f4-8c68-e7a471471337]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f08d66-b74c-426c-96c0-cbba300022cc]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[46783d5d-b690-40f7-a1cf-9dc161902864]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[91106c26-eb87-4b98-a221-94ac6745d6a6]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6a4d2-3a79-45d9-adfa-024987a33217]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a2da0-e11f-4861-baa7-924da77f430a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260]
Oct 20 13:15:26 user nova-compute[74701]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48, portal: 172.16.0.220,3260] successful.
Oct 20 13:15:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e19df4b-ad7a-48a4-9274-af74b3df7e48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee39e2fe-5fc6-4c9c-8300-b439d03e8c66]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] <== disconnect_volume: return (317ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:15:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lazy-loading 'flavor' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-e0a00404-805f-44d0-a8ed-eb4f1a24c162 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.101s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing instance network info cache due to event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:15:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:42 user nova-compute[74701]: DEBUG nova.network.neutron [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAsSJPtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:15:43 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:43 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:15:43 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bbe63e-b45d-4f3a-b8f1-034d716bbacd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:15:43 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a586fe3-3cd5-41a5-ae39-64432d775a91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0] added
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d87e2a-bd3b-4c73-852f-617c8c87b1aa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b0929-fd3a-415d-9944-6d275f502b13]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG nova.network.neutron [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updated VIF entry in instance network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG nova.network.neutron [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAsSJPtg {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af6d8a9c-4cbf-4815-9ae6-20b7608791ac req-89f27f39-115e-4d69-8ab0-2dc59576b74e service nova] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAsSJPtg" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f855e723-0a6c-49b2-8b0e-4e4663736b45]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAsSJPtg'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca313d0-dd39-4592-8d57-e008e42ea604]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a552758-0632-485f-98e8-1a53c1c0e006]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08a1685-ac83-410c-a739-465d57508570]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260]
Oct 20 13:15:43 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260] successful.
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b817fc31-f5af-4bf5-a179-18976e5b8140]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b888fcda-79ba-4dbd-95c1-17b526641e21]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)
Oct 20 13:15:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3f2b1-99d4-4e36-9c78-bb34a59e1ad2]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:15:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAsSJPtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26663383730323630', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663383730323630', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:15:44 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:44 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:15:44 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:15:44 user nova-compute[74701]:   <serial>b2629ced-a310-4182-a5ca-b27afb50a6a0</serial>
Oct 20 13:15:44 user nova-compute[74701]: </disk>
Oct 20 13:15:44 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:15:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:12:c9:35, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e204580-3518-4a3a-8541-1f7b701c8147 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.047s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:45 user nova-compute[74701]: INFO nova.compute.manager [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Detaching volume b2629ced-a310-4182-a5ca-b27afb50a6a0
Oct 20 13:15:45 user nova-compute[74701]: INFO nova.virt.block_device [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Attempting to driver detach volume b2629ced-a310-4182-a5ca-b27afb50a6a0 from mountpoint /dev/vdb
Oct 20 13:15:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Attempting to detach device vdb from instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:15:45 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:45 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:15:45 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:15:45 user nova-compute[74701]:   <serial>b2629ced-a310-4182-a5ca-b27afb50a6a0</serial>
Oct 20 13:15:45 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:15:45 user nova-compute[74701]: </disk>
Oct 20 13:15:45 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:15:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 from the persistent domain config.
Oct 20 13:15:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:15:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:15:45 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:15:45 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:15:45 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:15:45 user nova-compute[74701]:   <serial>b2629ced-a310-4182-a5ca-b27afb50a6a0</serial>
Oct 20 13:15:45 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:15:45 user nova-compute[74701]: </disk>
Oct 20 13:15:45 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:15:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:15:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:49 user nova-compute[74701]: INFO nova.compute.manager [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Shelving
Oct 20 13:15:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:49 user nova-compute[74701]: WARNING nova.compute.manager [req-364ec9c4-9327-4297-9436-c0d7844beed5 req-c0395347-1325-4210-a06d-7457b324ef46 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state active and task_state shelving.
Oct 20 13:15:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance destroyed successfully.
Oct 20 13:15:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Beginning cold snapshot process
Oct 20 13:15:50 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:15:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk /opt/stack/data/nova/instances/snapshots/tmpgaam5cxc/27252ace95f54a428e239fa221e1e98b {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk /opt/stack/data/nova/instances/snapshots/tmpgaam5cxc/27252ace95f54a428e239fa221e1e98b" returned: 0 in 0.747s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Snapshot extracted, beginning image upload
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:15:51 user nova-compute[74701]: INFO nova.compute.claims [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Claim successful on node user
Oct 20 13:15:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:15:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:15:51 user nova-compute[74701]: DEBUG nova.policy [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5447da7d31cf44ba84c5836599970f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73abb7994b4ce1b83d9d35b4a5e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:52 user nova-compute[74701]: WARNING nova.compute.manager [req-58c88459-1c79-40dd-9217-8f9de7875bf8 req-efa27127-e020-4ecb-9107-d4ba5b036237 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:15:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Creating image(s)
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "/opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "/opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "/opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk 1073741824" returned: 0 in 0.048s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Successfully created port: e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Cannot resize image /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Ensure instance console log exists: /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Successfully updated port: e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquired lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-changed-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Refreshing instance network info cache due to event network-changed-e53a6fb0-e81f-4853-af3e-e2b6f45d956e. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] Acquiring lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Updating instance_info_cache with network_info: [{"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Releasing lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Instance network_info: |[{"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] Acquired lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Refreshing network info cache for port e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Start _get_guest_xml network_info=[{"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:15:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761126974',display_name='tempest-VolumesActionsTest-instance-1761126974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761126974',id=25,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-autkndf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:15:52Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=37df8529-b7d2-4892-a3a5-c83c89e06ddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lazy-loading 'pci_devices' on Instance uuid 37df8529-b7d2-4892-a3a5-c83c89e06ddd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:15:53 user nova-compute[74701]:   <uuid>37df8529-b7d2-4892-a3a5-c83c89e06ddd</uuid>
Oct 20 13:15:53 user nova-compute[74701]:   <name>instance-00000019</name>
Oct 20 13:15:53 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:15:53 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:15:53 user nova-compute[74701]:   <metadata>
Oct 20 13:15:53 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:15:53 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:name>tempest-VolumesActionsTest-instance-1761126974</nova:name>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:15:53</nova:creationTime>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:15:53 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:15:53 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:owner>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:user uuid="5447da7d31cf44ba84c5836599970f3d">tempest-VolumesActionsTest-1955537551-project-member</nova:user>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:project uuid="0b73abb7994b4ce1b83d9d35b4a5e272">tempest-VolumesActionsTest-1955537551</nova:project>
Oct 20 13:15:53 user nova-compute[74701]:       </nova:owner>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:15:53 user nova-compute[74701]:       <nova:ports>
Oct 20 13:15:53 user nova-compute[74701]:         <nova:port uuid="e53a6fb0-e81f-4853-af3e-e2b6f45d956e">
Oct 20 13:15:53 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:15:53 user nova-compute[74701]:         </nova:port>
Oct 20 13:15:53 user nova-compute[74701]:       </nova:ports>
Oct 20 13:15:53 user nova-compute[74701]:     </nova:instance>
Oct 20 13:15:53 user nova-compute[74701]:   </metadata>
Oct 20 13:15:53 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:15:53 user nova-compute[74701]:     <system>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="serial">37df8529-b7d2-4892-a3a5-c83c89e06ddd</entry>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="uuid">37df8529-b7d2-4892-a3a5-c83c89e06ddd</entry>
Oct 20 13:15:53 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:15:53 user nova-compute[74701]:     </system>
Oct 20 13:15:53 user nova-compute[74701]:   </sysinfo>
Oct 20 13:15:53 user nova-compute[74701]:   <os>
Oct 20 13:15:53 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:15:53 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:15:53 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:15:53 user nova-compute[74701]:   </os>
Oct 20 13:15:53 user nova-compute[74701]:   <features>
Oct 20 13:15:53 user nova-compute[74701]:     <acpi/>
Oct 20 13:15:53 user nova-compute[74701]:     <apic/>
Oct 20 13:15:53 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:15:53 user nova-compute[74701]:   </features>
Oct 20 13:15:53 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:15:53 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:15:53 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:15:53 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:15:53 user nova-compute[74701]:   </clock>
Oct 20 13:15:53 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:15:53 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:15:53 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:15:53 user nova-compute[74701]:   </cpu>
Oct 20 13:15:53 user nova-compute[74701]:   <devices>
Oct 20 13:15:53 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:15:53 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:15:53 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk"/>
Oct 20 13:15:53 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:15:53 user nova-compute[74701]:     </disk>
Oct 20 13:15:53 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:15:53 user nova-compute[74701]:       <mac address="fa:16:3e:af:2e:64"/>
Oct 20 13:15:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:15:53 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:15:53 user nova-compute[74701]:       <target dev="tape53a6fb0-e8"/>
Oct 20 13:15:53 user nova-compute[74701]:     </interface>
Oct 20 13:15:53 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:15:53 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/console.log" append="off"/>
Oct 20 13:15:53 user nova-compute[74701]:     </serial>
Oct 20 13:15:53 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:15:53 user nova-compute[74701]:     <video>
Oct 20 13:15:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:15:53 user nova-compute[74701]:     </video>
Oct 20 13:15:53 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:15:53 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:15:53 user nova-compute[74701]:     </rng>
Oct 20 13:15:53 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:15:53 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:15:53 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:15:53 user nova-compute[74701]:     </memballoon>
Oct 20 13:15:53 user nova-compute[74701]:   </devices>
Oct 20 13:15:53 user nova-compute[74701]: </domain>
Oct 20 13:15:53 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761126974',display_name='tempest-VolumesActionsTest-instance-1761126974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761126974',id=25,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-autkndf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:15:52Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=37df8529-b7d2-4892-a3a5-c83c89e06ddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG os_vif [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96f63896-9fbb-539a-b7a3-49b757a4fbaf', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape53a6fb0-e8, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape53a6fb0-e8, col_values=(('qos', UUID('1b134290-46b2-45a9-9bda-f016836871eb')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape53a6fb0-e8, col_values=(('external_ids', {'iface-id': 'e53a6fb0-e81f-4853-af3e-e2b6f45d956e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:2e:64', 'vm-uuid': '37df8529-b7d2-4892-a3a5-c83c89e06ddd'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:53 user nova-compute[74701]: INFO os_vif [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8')
Oct 20 13:15:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Snapshot image upload complete
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] No VIF found with MAC fa:16:3e:af:2e:64, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:15:53 user nova-compute[74701]: INFO nova.compute.manager [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Shelve offloading
Oct 20 13:15:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance destroyed successfully.
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Updated VIF entry in instance network info cache for port e53a6fb0-e81f-4853-af3e-e2b6f45d956e. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Updating instance_info_cache with network_info: [{"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3e3a1db3-4351-4a76-9b84-edcb8d3266f3 req-ddd2ec8e-3435-4d1a-a206-65cfd0e00f0f service nova] Releasing lock "refresh_cache-37df8529-b7d2-4892-a3a5-c83c89e06ddd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:15:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance destroyed successfully.
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'resources' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/KEWGZFGCLdFwPKV1pah4nx6zxk2pfe5LGo37B+gmjIBM0NERgCoGz1dUbwQukcpOrm0jVNFGkc1pxWH6BlZNotFKl8swMLaq8bkOXQbIUvmpXI5M6ow4RZFwsMWz4mg==',key_name='tempest-keypair-704380112',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:15:53.838939',shelved_host='user',shelved_image_id='c6ef99a0-fcb1-4f58-ba26-13e9478237f1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG os_vif [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap119c01dd-e2, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing instance network info cache due to event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b52e1235-fb5c-4044-a221-b311c2bc6d6c) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:54 user nova-compute[74701]: INFO os_vif [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2')
Oct 20 13:15:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Deleting instance files /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8_del
Oct 20 13:15:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Deletion of /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8_del complete
Oct 20 13:15:54 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Deleted allocations for instance 39db995b-5a3b-4077-97fc-81996bb88dd8
Oct 20 13:15:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'numa_topology' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.objects.base [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<39db995b-5a3b-4077-97fc-81996bb88dd8> lazy-loaded attributes: resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updated VIF entry in instance network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap119c01dd-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-54ba7ee4-d672-44ee-8d4c-8dd2d133c0e5 req-e79c5017-7c5c-4365-b58c-6c5066376795 service nova] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a9547e8e-1027-4bc5-a4aa-908178429ede tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.954s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:56 user nova-compute[74701]: INFO nova.compute.manager [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Terminating instance
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-unplugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] No waiting events found dispatching network-vif-unplugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-da3f9ccd-5268-4b06-85e9-0b8539b3c8fa req-f2842d17-9eb8-4727-94df-c3f0489cd6b2 service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-unplugged-41f10cfb-5dbc-44f7-989c-3d550aef436c for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] No waiting events found dispatching network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:56 user nova-compute[74701]: WARNING nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received unexpected event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e for instance with vm_state building and task_state spawning.
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] No waiting events found dispatching network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:56 user nova-compute[74701]: WARNING nova.compute.manager [req-e077c05d-d37d-4cc5-b063-5233dc8abe40 req-b27b69ab-931e-4270-991e-4dee1ec18906 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received unexpected event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e for instance with vm_state building and task_state spawning.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Instance destroyed successfully.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lazy-loading 'resources' on Instance uuid 49cd00ef-639e-45d4-8681-4076ce232be8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2036508820',display_name='tempest-TestVolumeSwap-server-2036508820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2036508820',id=15,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EjFDWuJ4jtrOpG7HIJoqUbupHJG9a0sJ/lzXLhd+NWBCiO3G4U9UcMaMgWE1Adg91FeuC1plzMr99H1VWdVpjk6sM42L+VelPe0t5saPoI53LV7rPWtKVq7S1nNsslA==',key_name='tempest-keypair-1828142458',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95261e7276ff4097ab6d975482f9e803',ramdisk_id='',reservation_id='r-lv164sdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-904718920',owner_user_name='tempest-TestVolumeSwap-904718920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055ddddbedde4ecfb7db9c52a8f415ce',uuid=49cd00ef-639e-45d4-8681-4076ce232be8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converting VIF {"id": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "address": "fa:16:3e:fb:87:0f", "network": {"id": "c623e0c8-bf3f-47ac-8c44-580385c80877", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622270302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95261e7276ff4097ab6d975482f9e803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f10cfb-5d", "ovs_interfaceid": "41f10cfb-5dbc-44f7-989c-3d550aef436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG os_vif [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41f10cfb-5d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fbbbee1-d049-45fd-aac5-51c12510a50b) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:15:57 user nova-compute[74701]: INFO os_vif [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:87:0f,bridge_name='br-int',has_traffic_filtering=True,id=41f10cfb-5dbc-44f7-989c-3d550aef436c,network=Network(c623e0c8-bf3f-47ac-8c44-580385c80877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f10cfb-5d')
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Deleting instance files /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8_del
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Deletion of /opt/stack/data/nova/instances/49cd00ef-639e-45d4-8681-4076ce232be8_del complete
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.compute.manager [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '49cd00ef-639e-45d4-8681-4076ce232be8' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '49cd00ef-639e-45d4-8681-4076ce232be8' (instance-0000000f)
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Instance spawned successfully.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:15:57 user nova-compute[74701]: INFO nova.compute.manager [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Took 6.47 seconds to build instance.
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f331fd95-66b2-4ac4-8026-65a862287c01 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:57 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:15:58 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Took 0.82 seconds to deallocate network for instance.
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:58 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Deleted allocations for instance 49cd00ef-639e-45d4-8681-4076ce232be8
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] Acquiring lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] Lock "49cd00ef-639e-45d4-8681-4076ce232be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] No waiting events found dispatching network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:15:58 user nova-compute[74701]: WARNING nova.compute.manager [req-4fc460e2-b680-402d-98ca-032acaaf64a0 req-c496026e-3e08-48a8-891a-818853e0db2d service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received unexpected event network-vif-plugged-41f10cfb-5dbc-44f7-989c-3d550aef436c for instance with vm_state deleted and task_state None.
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-588ea54f-5209-49f9-9e80-b53f53585d61 tempest-TestVolumeSwap-904718920 tempest-TestVolumeSwap-904718920-project-member] Lock "49cd00ef-639e-45d4-8681-4076ce232be8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-79b0e66e-8e09-40f5-8226-0ae5138cf3a1 req-68f91112-0190-42ee-9a69-4b547e16c71c service nova] [instance: 49cd00ef-639e-45d4-8681-4076ce232be8] Received event network-vif-deleted-41f10cfb-5dbc-44f7-989c-3d550aef436c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:15:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:02 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:02 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7246MB free_disk=25.086196899414062GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a15f5418-3bc2-4e67-9d41-1d3575677b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance c29487d5-c955-40a5-b9f8-15b539bf19f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 37df8529-b7d2-4892-a3a5-c83c89e06ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:02 user nova-compute[74701]: INFO nova.compute.manager [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Terminating instance
Oct 20 13:16:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-unplugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] No waiting events found dispatching network-vif-unplugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-e0f58fe3-2801-4f96-b567-1f95b8c4a9bf req-ebf9ba7b-df50-4550-b80f-e6bff421f293 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-unplugged-b951a7e9-683b-4528-bf80-88a93a136a02 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Instance destroyed successfully.
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.objects.instance [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lazy-loading 'resources' on Instance uuid a15f5418-3bc2-4e67-9d41-1d3575677b83 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2070259435',display_name='tempest-ServersNegativeTestJSON-server-2070259435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2070259435',id=20,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:14:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-w4y2z9dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:14:20Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=a15f5418-3bc2-4e67-9d41-1d3575677b83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "b951a7e9-683b-4528-bf80-88a93a136a02", "address": "fa:16:3e:18:11:a8", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb951a7e9-68", "ovs_interfaceid": "b951a7e9-683b-4528-bf80-88a93a136a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG os_vif [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb951a7e9-68, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6118e90a-6521-47e2-b122-0bd7b9fcb528) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:03 user nova-compute[74701]: INFO os_vif [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:11:a8,bridge_name='br-int',has_traffic_filtering=True,id=b951a7e9-683b-4528-bf80-88a93a136a02,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb951a7e9-68')
Oct 20 13:16:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Deleting instance files /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83_del
Oct 20 13:16:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Deletion of /opt/stack/data/nova/instances/a15f5418-3bc2-4e67-9d41-1d3575677b83_del complete
Oct 20 13:16:03 user nova-compute[74701]: INFO nova.compute.manager [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 13:16:03 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:16:03 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-ebcd085e-d8fa-4cac-a47e-cb0a2653377c req-e1077e48-27ca-4a0f-87bc-f419ab7f6bf2 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-deleted-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:04 user nova-compute[74701]: INFO nova.compute.manager [req-ebcd085e-d8fa-4cac-a47e-cb0a2653377c req-e1077e48-27ca-4a0f-87bc-f419ab7f6bf2 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Neutron deleted interface b951a7e9-683b-4528-bf80-88a93a136a02; detaching it from the instance and deleting it from the info cache
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-ebcd085e-d8fa-4cac-a47e-cb0a2653377c req-e1077e48-27ca-4a0f-87bc-f419ab7f6bf2 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:04 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Took 0.66 seconds to deallocate network for instance.
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-ebcd085e-d8fa-4cac-a47e-cb0a2653377c req-e1077e48-27ca-4a0f-87bc-f419ab7f6bf2 service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Detach interface failed, port_id=b951a7e9-683b-4528-bf80-88a93a136a02, reason: Instance a15f5418-3bc2-4e67-9d41-1d3575677b83 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:16:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:05 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Deleted allocations for instance a15f5418-3bc2-4e67-9d41-1d3575677b83
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-52768e97-0ae8-43e5-8d5f-5003078fedef tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] Acquiring lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] Lock "a15f5418-3bc2-4e67-9d41-1d3575677b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] No waiting events found dispatching network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:05 user nova-compute[74701]: WARNING nova.compute.manager [req-28a61eee-7616-4a30-9c24-af921e257fbb req-9afa2696-ecf1-4ed9-8105-aec986493d2e service nova] [instance: a15f5418-3bc2-4e67-9d41-1d3575677b83] Received unexpected event network-vif-plugged-b951a7e9-683b-4528-bf80-88a93a136a02 for instance with vm_state deleted and task_state None.
Oct 20 13:16:06 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 is timed out.
Oct 20 13:16:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86 from the live domain config.
Oct 20 13:16:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAsSJPtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:16:06 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b3558-6bc3-4aaa-a77f-38885b8a02f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:16:06 user nova-compute[74701]: No targets found.
Oct 20 13:16:06 user nova-compute[74701]: iSNS:
Oct 20 13:16:06 user nova-compute[74701]: No targets found.
Oct 20 13:16:06 user nova-compute[74701]: STATIC:
Oct 20 13:16:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:16:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:16:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:16:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0
Oct 20 13:16:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:16:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:16:06 user nova-compute[74701]: FIRMWARE:
Oct 20 13:16:06 user nova-compute[74701]: No targets found.
Oct 20 13:16:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:16:06 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:16:06 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1b9b6-6b5c-4690-b7b2-7392f63b8d1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96243a1-be28-486b-b3ef-143035288254]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:06 user nova-compute[74701]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)
Oct 20 13:16:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:06 user nova-compute[74701]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 (non-flash)
Oct 20 13:16:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc7dfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff633c37-c6c3-4e92-a7d5-c2560c4bc24a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27793c52-3663-4d40-92d5-567cc97e568e]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd60fa8-0355-489f-bce6-b04afd6480d7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878a526-8ace-4c1c-8503-79fd6c5ab4fc]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce619cc6-71c8-4246-810d-5213c2048f11]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553713f-b34f-4fcc-81fc-b836d8127ce6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260]
Oct 20 13:16:06 user nova-compute[74701]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0, portal: 172.16.0.220,3260] successful.
Oct 20 13:16:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2629ced-a310-4182-a5ca-b27afb50a6a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915f84f-62f4-412d-81f8-e86df9d451fa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== disconnect_volume: return (308ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:16:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:16:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-589557b4-22f3-4dd3-9c5b-617f7605d6cb tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing instance network info cache due to event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:16:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:16:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:16:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:16:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated VIF entry in instance network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:16:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd448bd8-369e-431e-968d-26dd09f51f93 req-f4b45069-c44f-46af-aea9-fcd20122c156 service nova] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:16:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:26 user nova-compute[74701]: INFO nova.compute.manager [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Rescuing
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:26 user nova-compute[74701]: WARNING nova.compute.manager [req-897bcd8d-697e-49eb-81c1-3b32ec090cc5 req-d0452311-b906-46e3-b5ee-59c3f5e97389 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state active and task_state rescuing.
Oct 20 13:16:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance destroyed successfully.
Oct 20 13:16:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Attempting a stable device rescue
Oct 20 13:16:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74701) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:16:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Creating image(s)
Oct 20 13:16:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "077ad8e1cf2a6deb8e064147e4869a702297b315" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "077ad8e1cf2a6deb8e064147e4869a702297b315" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG nova.virt.images [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] 31c7f879-b284-4d04-882a-27d056361bcb was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.part /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.part /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.converted" returned: 0 in 0.253s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:28 user nova-compute[74701]: WARNING nova.compute.manager [req-7fbd783d-2f5b-4e27-a7ec-5a43f4a15f56 req-fccdf5ed-37c3-42e1-8d6e-18877ead90ef service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state active and task_state rescuing.
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "077ad8e1cf2a6deb8e064147e4869a702297b315" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.581s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "077ad8e1cf2a6deb8e064147e4869a702297b315" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "077ad8e1cf2a6deb8e064147e4869a702297b315" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315 --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315,backing_fmt=raw /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315,backing_fmt=raw /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue" returned: 0 in 0.055s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "077ad8e1cf2a6deb8e064147e4869a702297b315" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'migration_context' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<4053c98d-7a1e-4019-84b5-0ae71af9ff95> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start _get_guest_xml network_info=[{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:16:c4:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '31c7f879-b284-4d04-882a-27d056361bcb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4053c98d-7a1e-4019-84b5-0ae71af9ff95', 'attached_at': '', 'detached_at': '', 'volume_id': '5321679c-49d9-4caf-99ec-5af541fd2ac5', 'serial': '5321679c-49d9-4caf-99ec-5af541fd2ac5'}, 'attachment_id': '1fd47353-2f09-47f2-936a-8d851f4ca6e3', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<4053c98d-7a1e-4019-84b5-0ae71af9ff95> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'numa_topology' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<4053c98d-7a1e-4019-84b5-0ae71af9ff95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<4053c98d-7a1e-4019-84b5-0ae71af9ff95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:16:29 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:16:29 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:16:29 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5b428-4fba-4f40-bba0-bd69bc6820fe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zVPdbkAG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 13:16:29 user nova-compute[74701]: node.name = iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:16:29 user nova-compute[74701]: node.tpgt = -1
Oct 20 13:16:29 user nova-compute[74701]: node.startup = automatic
Oct 20 13:16:29 user nova-compute[74701]: node.leading_login = No
Oct 20 13:16:29 user nova-compute[74701]: iface.iscsi_ifacename = default
Oct 20 13:16:29 user nova-compute[74701]: iface.net_ifacename = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.ipaddress = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.prefix_len = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.hwaddress = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.transport_name = tcp
Oct 20 13:16:29 user nova-compute[74701]: iface.initiatorname = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.vlan_id = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.vlan_priority = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.vlan_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.iface_num = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.mtu = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.port = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.bootproto = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.subnet_mask = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.gateway = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_alt_client_id = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_dns = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_learn_iqn = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_vendor_id_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_vendor_id = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.dhcp_slp_da = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.fragmentation = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.gratuitous_arp = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.incoming_forwarding = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.tos_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.tos = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.ttl = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.delayed_ack = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.tcp_nagle = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.tcp_wsf_state = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.tcp_wsf = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.tcp_timer_scale = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.tcp_timestamp = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.redirect = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.def_task_mgmt_timeout = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.header_digest = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.data_digest = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.immediate_data = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.initial_r2t = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.data_seq_inorder = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.data_pdu_inorder = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.erl = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.max_receive_data_len = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.first_burst_len = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.max_outstanding_r2t = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.max_burst_len = 0
Oct 20 13:16:29 user nova-compute[74701]: iface.chap_auth = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.bidi_chap = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.strict_login_compliance = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.discovery_auth = <empty>
Oct 20 13:16:29 user nova-compute[74701]: iface.discovery_logout = <empty>
Oct 20 13:16:29 user nova-compute[74701]: node.discovery_address = <empty>
Oct 20 13:16:29 user nova-compute[74701]: node.discovery_port = 0
Oct 20 13:16:29 user nova-compute[74701]: node.discovery_type = static
Oct 20 13:16:29 user nova-compute[74701]: node.session.initial_cmdsn = 0
Oct 20 13:16:29 user nova-compute[74701]: node.session.initial_login_retry_max = 8
Oct 20 13:16:29 user nova-compute[74701]: node.session.xmit_thread_priority = -20
Oct 20 13:16:29 user nova-compute[74701]: node.session.cmds_max = 128
Oct 20 13:16:29 user nova-compute[74701]: node.session.queue_depth = 32
Oct 20 13:16:29 user nova-compute[74701]: node.session.nr_sessions = 1
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.authmethod = CHAP
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.username = zVPdbkAG
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.password = ***
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.username_in = <empty>
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.password_in = <empty>
Oct 20 13:16:29 user nova-compute[74701]: node.session.auth.chap_algs = MD5
Oct 20 13:16:29 user nova-compute[74701]: node.session.timeo.replacement_timeout = 120
Oct 20 13:16:29 user nova-compute[74701]: node.session.err_timeo.abort_timeout = 15
Oct 20 13:16:29 user nova-compute[74701]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 13:16:29 user nova-compute[74701]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 13:16:29 user nova-compute[74701]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.FastAbort = Yes
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.InitialR2T = No
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.ImmediateData = Yes
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.MaxConnections = 1
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 13:16:29 user nova-compute[74701]: node.session.iscsi.ERL = 0
Oct 20 13:16:29 user nova-compute[74701]: node.session.scan = manual
Oct 20 13:16:29 user nova-compute[74701]: node.session.reopen_max = 0
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].address = 172.16.0.220
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].port = 3260
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].startup = manual
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].tcp.window_size = 524288
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].tcp.type_of_service = 0
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].timeo.logout_timeout = 15
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].timeo.login_timeout = 15
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].timeo.auth_timeout = 45
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.DataDigest = None
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.IFMarker = No
Oct 20 13:16:29 user nova-compute[74701]: node.conn[0].iscsi.OFMarker = No
Oct 20 13:16:29 user nova-compute[74701]: # END RECORD
Oct 20 13:16:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9049cee2-d03a-4990-96c9-453f27cf35ef]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a9000-0068-4461-bc10-6ecc6b762c7c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVPdbkAG {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVPdbkAG" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fc6cac-1a54-486f-a668-244e4148d7e2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVPdbkAG'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd0922-a88a-4f47-bd86-28edda412f4a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6454b3a1-5a7a-428c-8f7f-48bb53afafea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.125s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] HCTL ('34', '0', '0', 0) found on session 19 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f600d8f-c132-4691-bf9b-7d695ba363fc]: (4, ('0 0 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching for a device in session 19 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.149s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== connect_volume: return (150ms) {'type': 'block', 'scsi_wwn': '26263303866323237', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263303866323237', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-104078597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-104078597',id=22,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-8p43it6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:15:15Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=4053c98d-7a1e-4019-84b5-0ae71af9ff95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:16:c4:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:16:c4:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.objects.base [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<4053c98d-7a1e-4019-84b5-0ae71af9ff95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:16:29 user nova-compute[74701]:   <uuid>4053c98d-7a1e-4019-84b5-0ae71af9ff95</uuid>
Oct 20 13:16:29 user nova-compute[74701]:   <name>instance-00000016</name>
Oct 20 13:16:29 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:16:29 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:16:29 user nova-compute[74701]:   <metadata>
Oct 20 13:16:29 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:16:29 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-104078597</nova:name>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:16:29</nova:creationTime>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:16:29 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:16:29 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:owner>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:16:29 user nova-compute[74701]:       </nova:owner>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:16:29 user nova-compute[74701]:       <nova:ports>
Oct 20 13:16:29 user nova-compute[74701]:         <nova:port uuid="ef878f89-a7a8-42aa-8e95-d0f07446c226">
Oct 20 13:16:29 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:16:29 user nova-compute[74701]:         </nova:port>
Oct 20 13:16:29 user nova-compute[74701]:       </nova:ports>
Oct 20 13:16:29 user nova-compute[74701]:     </nova:instance>
Oct 20 13:16:29 user nova-compute[74701]:   </metadata>
Oct 20 13:16:29 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:16:29 user nova-compute[74701]:     <system>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="serial">4053c98d-7a1e-4019-84b5-0ae71af9ff95</entry>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="uuid">4053c98d-7a1e-4019-84b5-0ae71af9ff95</entry>
Oct 20 13:16:29 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:16:29 user nova-compute[74701]:     </system>
Oct 20 13:16:29 user nova-compute[74701]:   </sysinfo>
Oct 20 13:16:29 user nova-compute[74701]:   <os>
Oct 20 13:16:29 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:16:29 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:16:29 user nova-compute[74701]:   </os>
Oct 20 13:16:29 user nova-compute[74701]:   <features>
Oct 20 13:16:29 user nova-compute[74701]:     <acpi/>
Oct 20 13:16:29 user nova-compute[74701]:     <apic/>
Oct 20 13:16:29 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:16:29 user nova-compute[74701]:   </features>
Oct 20 13:16:29 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:16:29 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:16:29 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:16:29 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:16:29 user nova-compute[74701]:   </clock>
Oct 20 13:16:29 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:16:29 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:16:29 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:16:29 user nova-compute[74701]:   </cpu>
Oct 20 13:16:29 user nova-compute[74701]:   <devices>
Oct 20 13:16:29 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:16:29 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:16:29 user nova-compute[74701]:       <source dev="/dev/sdc"/>
Oct 20 13:16:29 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:16:29 user nova-compute[74701]:       <serial>5321679c-49d9-4caf-99ec-5af541fd2ac5</serial>
Oct 20 13:16:29 user nova-compute[74701]:     </disk>
Oct 20 13:16:29 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:16:29 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:16:29 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue"/>
Oct 20 13:16:29 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:16:29 user nova-compute[74701]:       <boot order="1"/>
Oct 20 13:16:29 user nova-compute[74701]:     </disk>
Oct 20 13:16:29 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:16:29 user nova-compute[74701]:       <mac address="fa:16:3e:16:c4:94"/>
Oct 20 13:16:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:16:29 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:16:29 user nova-compute[74701]:       <target dev="tapef878f89-a7"/>
Oct 20 13:16:29 user nova-compute[74701]:     </interface>
Oct 20 13:16:29 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:16:29 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/console.log" append="off"/>
Oct 20 13:16:29 user nova-compute[74701]:     </serial>
Oct 20 13:16:29 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:16:29 user nova-compute[74701]:     <video>
Oct 20 13:16:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:16:29 user nova-compute[74701]:     </video>
Oct 20 13:16:29 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:16:29 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:16:29 user nova-compute[74701]:     </rng>
Oct 20 13:16:29 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:16:29 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:16:29 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:16:29 user nova-compute[74701]:     </memballoon>
Oct 20 13:16:29 user nova-compute[74701]:   </devices>
Oct 20 13:16:29 user nova-compute[74701]: </domain>
Oct 20 13:16:29 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:16:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance destroyed successfully.
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:16:c4:94, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:16:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:31 user nova-compute[74701]: WARNING nova.compute.manager [req-0974a32c-34b8-48a7-9f0d-cda4ad3c8d10 req-d626b1ca-6d94-4abe-a292-a013a5a86453 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state active and task_state rescuing.
Oct 20 13:16:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:33 user nova-compute[74701]: WARNING nova.compute.manager [req-7b6412b8-b452-4d70-9201-929e1be74752 req-6a050124-7bbe-452b-9f8b-6e7a8b77ee56 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state active and task_state rescuing.
Oct 20 13:16:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-31d88a1c-b7be-4b9f-b9e3-6d73815818fc tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:16:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing instance network info cache due to event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:16:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:16:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:16:34 user nova-compute[74701]: DEBUG nova.network.neutron [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'flavor' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updated VIF entry in instance network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-312318b5-5374-49df-81ad-11a0745a4dc4 req-b28ddb30-8ea8-4c74-b00a-eddeaebd482e service nova] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:35 user nova-compute[74701]: INFO nova.compute.manager [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Attaching volume f8d97739-6436-4ee3-94e6-69d6b46c76cf to /dev/vdb
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390b603-ef8a-4091-bad6-53444127b9c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a91390-542c-41d3-a006-068ebd79fc2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d842ecc-c8ba-4ed4-ac1f-c10c8bc1d39d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5328f7-26a5-4272-8775-ef3d2793716a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:16:35 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:16:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1f4d4b-a7b4-470c-9af9-8b61f0e58574]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:16:35 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating existing volume attachment record: 80004d6c-de1a-4783-9f65-a052f418b091 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:36 user nova-compute[74701]: INFO nova.compute.manager [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Terminating instance
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-unplugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] No waiting events found dispatching network-vif-unplugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-550579de-905f-45df-9806-480b27cc4abf req-f08c171c-9a15-40a1-b691-5a42a6d5ca05 service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-unplugged-377c2851-f2c8-4169-9d10-11543a0254ec for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Instance destroyed successfully.
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'resources' on Instance uuid b8ca3042-e49a-4ae4-83f3-4e3512d39a86 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208353718',display_name='tempest-AttachVolumeNegativeTest-server-208353718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208353718',id=18,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLOjzODboKn9Us81I5rmSrTgEVEvCKaO1m0CGNeI7oblx+fkv3nI24eCKa5QwsIKxBEyQv+Pl0N0bQFwuGIU2SxL96KHw7cdpXHcuTQ92SZ4MDlw4qOdVdWhX7J5EddGQ==',key_name='tempest-keypair-657395957',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-sh2ems2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=b8ca3042-e49a-4ae4-83f3-4e3512d39a86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "377c2851-f2c8-4169-9d10-11543a0254ec", "address": "fa:16:3e:12:c9:35", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c2851-f2", "ovs_interfaceid": "377c2851-f2c8-4169-9d10-11543a0254ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG os_vif [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377c2851-f2, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5292546e-8156-477b-b601-93af15c2c440) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:37 user nova-compute[74701]: INFO os_vif [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:c9:35,bridge_name='br-int',has_traffic_filtering=True,id=377c2851-f2c8-4169-9d10-11543a0254ec,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c2851-f2')
Oct 20 13:16:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Deleting instance files /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86_del
Oct 20 13:16:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Deletion of /opt/stack/data/nova/instances/b8ca3042-e49a-4ae4-83f3-4e3512d39a86_del complete
Oct 20 13:16:37 user nova-compute[74701]: INFO nova.compute.manager [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 13:16:37 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:16:37 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:38 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Took 1.14 seconds to deallocate network for instance.
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-f9c824f3-1350-4c95-bcf9-d4c5ae0d567a req-dd8027a9-8b13-4b4a-882b-86c85c0148ed service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-deleted-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] Acquiring lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] No waiting events found dispatching network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:38 user nova-compute[74701]: WARNING nova.compute.manager [req-07977ffb-dcda-49b2-a766-fb496af56b47 req-d23543c5-48e5-4ffa-b75d-b6d9eeca1d3c service nova] [instance: b8ca3042-e49a-4ae4-83f3-4e3512d39a86] Received unexpected event network-vif-plugged-377c2851-f2c8-4169-9d10-11543a0254ec for instance with vm_state deleted and task_state None.
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:38 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Deleted allocations for instance b8ca3042-e49a-4ae4-83f3-4e3512d39a86
Oct 20 13:16:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5974b3f2-c44f-400a-8043-c40a4aa40e59 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "b8ca3042-e49a-4ae4-83f3-4e3512d39a86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'flavor' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:45 user nova-compute[74701]: INFO nova.compute.manager [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Attaching volume 7152b709-3534-4f9f-a44d-8495533202dc to /dev/vdb
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.utils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc86ec-f89d-4612-a8bc-b13e2e79b2b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82201b47-4a03-4d96-9d7c-f4c7d6dde574]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4a6e5-06e8-465a-ad2d-0fae465a10e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabb4c6-e0a5-480b-818e-572b33f41999]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:16:45 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:16:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fde94-ba83-4e9f-8a0a-01fe2ae6b7af]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG os_brick.utils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:16:45 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating existing volume attachment record: 8f8fd5f3-b154-45d7-b431-0cc3f856e6e5 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:16:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:51 user nova-compute[74701]: INFO nova.compute.manager [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Terminating instance
Oct 20 13:16:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-unplugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] No waiting events found dispatching network-vif-unplugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-945e12d8-8305-423e-ae3a-8dc34b7dd7f0 req-cd8f5c4e-2695-4293-a849-3b4f9760be9f service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-unplugged-2ebb6478-4dbc-41a9-8901-917b4cae213c for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:16:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Instance destroyed successfully.
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lazy-loading 'resources' on Instance uuid c29487d5-c955-40a5-b9f8-15b539bf19f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122873609',display_name='tempest-VolumesActionsTest-instance-2122873609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122873609',id=24,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a261f1898367489881befeab0d825c59',ramdisk_id='',reservation_id='r-g6go8n0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1549387927',owner_user_name='tempest-VolumesActionsTest-1549387927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:14:53Z,user_data=None,user_id='5fe2bdad98cf4bdfbcb30ceca45384a0',uuid=c29487d5-c955-40a5-b9f8-15b539bf19f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converting VIF {"id": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "address": "fa:16:3e:a5:ec:98", "network": {"id": "efd79cdd-3be7-459d-96d1-db7aeece8754", "bridge": "br-int", "label": "tempest-VolumesActionsTest-830457686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a261f1898367489881befeab0d825c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebb6478-4d", "ovs_interfaceid": "2ebb6478-4dbc-41a9-8901-917b4cae213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG os_vif [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ebb6478-4d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0bb58e7-8297-440c-8f8f-93c706dd5bd4) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:52 user nova-compute[74701]: INFO os_vif [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ec:98,bridge_name='br-int',has_traffic_filtering=True,id=2ebb6478-4dbc-41a9-8901-917b4cae213c,network=Network(efd79cdd-3be7-459d-96d1-db7aeece8754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebb6478-4d')
Oct 20 13:16:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Deleting instance files /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4_del
Oct 20 13:16:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Deletion of /opt/stack/data/nova/instances/c29487d5-c955-40a5-b9f8-15b539bf19f4_del complete
Oct 20 13:16:52 user nova-compute[74701]: INFO nova.compute.manager [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:52 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Took 0.50 seconds to deallocate network for instance.
Oct 20 13:16:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-c27480ef-77bd-47e4-9816-3eb2b4e4478b req-86f66001-d45c-4122-bca6-a4f21c02f309 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-deleted-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:53 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Deleted allocations for instance c29487d5-c955-40a5-b9f8-15b539bf19f4
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6791ef27-29e7-485b-a233-39cd4c24bdb7 tempest-VolumesActionsTest-1549387927 tempest-VolumesActionsTest-1549387927-project-member] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.785s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAkXEpje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:16:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:16:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:16:53 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[66984de9-a3f2-41d1-ab04-1e989384603e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:16:53 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f894fefc-c5f5-4e41-a7c9-6b0363c8eda8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf] added
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[444e86c8-908f-4fd8-b767-08cafd7d8b1d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff94f20-4e19-40a9-b98f-038a3f69125b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAkXEpje {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAkXEpje" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[92938676-ad63-4b69-83f5-1a0191ddee40]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lAkXEpje'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8a518f-6e03-4479-b411-2d7998f577ef]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5dcaa-0716-48e5-82f2-5eb4f159f1a0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d5cd93-449d-4d50-82b1-999b43221b85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260]
Oct 20 13:16:53 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260] successful.
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eacb1d-b30b-497a-9481-aa538afde533]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c922fa2c-2cfd-43bb-b89b-d890410c3dab]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:53 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:16:53 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:16:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc9168-2504-4159-9bb3-870e3e23884f]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:16:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] Acquiring lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] Lock "c29487d5-c955-40a5-b9f8-15b539bf19f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] No waiting events found dispatching network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:54 user nova-compute[74701]: WARNING nova.compute.manager [req-93743b27-ca14-45f7-8efd-7b337e96cbfe req-02db092c-9c3d-4480-a4de-d5819e8a8746 service nova] [instance: c29487d5-c955-40a5-b9f8-15b539bf19f4] Received unexpected event network-vif-plugged-2ebb6478-4dbc-41a9-8901-917b4cae213c for instance with vm_state deleted and task_state None.
Oct 20 13:16:54 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAkXEpje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23564323364623466', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564323364623466', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'flavor' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:16:54 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:16:54 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:16:54 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:16:54 user nova-compute[74701]:   <serial>f8d97739-6436-4ee3-94e6-69d6b46c76cf</serial>
Oct 20 13:16:54 user nova-compute[74701]: </disk>
Oct 20 13:16:54 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:16:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:df:20:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:16:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72b55a42-c271-4c7c-ba47-d866b721d94d tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.042s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:55 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:56 user nova-compute[74701]: INFO nova.compute.manager [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Rescuing
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:16:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:57 user nova-compute[74701]: WARNING nova.compute.manager [req-fd684196-41c4-4d03-b7a4-171d051556df req-264be222-a0ba-42bb-bc91-87cffd53cc94 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state active and task_state rescuing.
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance destroyed successfully.
Oct 20 13:16:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Attempting rescue
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74701) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:16:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Creating image(s)
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'trusted_certs' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue" returned: 0 in 0.057s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'migration_context' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d15383e1-cb58-4069-82ae-d1ceaa1a2e7f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start _get_guest_xml network_info=[{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:df:20:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d15383e1-cb58-4069-82ae-d1ceaa1a2e7f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'numa_topology' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d15383e1-cb58-4069-82ae-d1ceaa1a2e7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:58 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:58 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'vcpu_model' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d15383e1-cb58-4069-82ae-d1ceaa1a2e7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-137752104',display_name='tempest-ServerRescueNegativeTestJSON-server-137752104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-137752104',id=23,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6MyZeHF4TZQ95c9gGZafULpwah2Iu6lvsYuO+mdk/qOBWWK1mxLCvBr/3EFUp97kcu/X57uaE51+1q+RKkvWqujl8tjbpHTzQ94H6HfvS6hcaUagYQmFny1qLvJ6dvpg==',key_name='tempest-keypair-869580081',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-qxa6mm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d15383e1-cb58-4069-82ae-d1ceaa1a2e7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:df:20:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "vif_mac": "fa:16:3e:df:20:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'pci_devices' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Object Instance<d15383e1-cb58-4069-82ae-d1ceaa1a2e7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:16:58 user nova-compute[74701]:   <uuid>d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</uuid>
Oct 20 13:16:58 user nova-compute[74701]:   <name>instance-00000017</name>
Oct 20 13:16:58 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:16:58 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:16:58 user nova-compute[74701]:   <metadata>
Oct 20 13:16:58 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:16:58 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-137752104</nova:name>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:16:58</nova:creationTime>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:16:58 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:16:58 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:owner>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:user uuid="a5a2fb1012774de08b84f6593eae8073">tempest-ServerRescueNegativeTestJSON-574725930-project-member</nova:user>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:project uuid="a9e48ad264d74341a6ee4c5d420385d0">tempest-ServerRescueNegativeTestJSON-574725930</nova:project>
Oct 20 13:16:58 user nova-compute[74701]:       </nova:owner>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:16:58 user nova-compute[74701]:       <nova:ports>
Oct 20 13:16:58 user nova-compute[74701]:         <nova:port uuid="0bf1252a-3258-4278-80d1-bff6c2aad9cb">
Oct 20 13:16:58 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:16:58 user nova-compute[74701]:         </nova:port>
Oct 20 13:16:58 user nova-compute[74701]:       </nova:ports>
Oct 20 13:16:58 user nova-compute[74701]:     </nova:instance>
Oct 20 13:16:58 user nova-compute[74701]:   </metadata>
Oct 20 13:16:58 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:16:58 user nova-compute[74701]:     <system>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="serial">d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</entry>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="uuid">d15383e1-cb58-4069-82ae-d1ceaa1a2e7f</entry>
Oct 20 13:16:58 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:16:58 user nova-compute[74701]:     </system>
Oct 20 13:16:58 user nova-compute[74701]:   </sysinfo>
Oct 20 13:16:58 user nova-compute[74701]:   <os>
Oct 20 13:16:58 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:16:58 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:16:58 user nova-compute[74701]:   </os>
Oct 20 13:16:58 user nova-compute[74701]:   <features>
Oct 20 13:16:58 user nova-compute[74701]:     <acpi/>
Oct 20 13:16:58 user nova-compute[74701]:     <apic/>
Oct 20 13:16:58 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:16:58 user nova-compute[74701]:   </features>
Oct 20 13:16:58 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:16:58 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:16:58 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:16:58 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:16:58 user nova-compute[74701]:   </clock>
Oct 20 13:16:58 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:16:58 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:16:58 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:16:58 user nova-compute[74701]:   </cpu>
Oct 20 13:16:58 user nova-compute[74701]:   <devices>
Oct 20 13:16:58 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:16:58 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:16:58 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue"/>
Oct 20 13:16:58 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:16:58 user nova-compute[74701]:     </disk>
Oct 20 13:16:58 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:16:58 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:16:58 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk"/>
Oct 20 13:16:58 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:16:58 user nova-compute[74701]:     </disk>
Oct 20 13:16:58 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:16:58 user nova-compute[74701]:       <mac address="fa:16:3e:df:20:71"/>
Oct 20 13:16:58 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:16:58 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:16:58 user nova-compute[74701]:       <target dev="tap0bf1252a-32"/>
Oct 20 13:16:58 user nova-compute[74701]:     </interface>
Oct 20 13:16:58 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:16:58 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/console.log" append="off"/>
Oct 20 13:16:58 user nova-compute[74701]:     </serial>
Oct 20 13:16:58 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:16:58 user nova-compute[74701]:     <video>
Oct 20 13:16:58 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:16:58 user nova-compute[74701]:     </video>
Oct 20 13:16:58 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:16:58 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:16:58 user nova-compute[74701]:     </rng>
Oct 20 13:16:58 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:16:58 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:16:58 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:16:58 user nova-compute[74701]:     </memballoon>
Oct 20 13:16:58 user nova-compute[74701]:   </devices>
Oct 20 13:16:58 user nova-compute[74701]: </domain>
Oct 20 13:16:58 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:16:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance destroyed successfully.
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] No VIF found with MAC fa:16:3e:df:20:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:16:59 user nova-compute[74701]: WARNING nova.compute.manager [req-b9c0c516-cfb8-4d8c-ab95-62a493b61d4e req-b02a1871-88c7-49db-8af2-63661a50dded service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state active and task_state rescuing.
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:16:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:17:01 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:01 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.091018676757812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:01 user nova-compute[74701]: WARNING nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state active and task_state rescuing.
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:01 user nova-compute[74701]: WARNING nova.compute.manager [req-bd9c2e8b-da6c-48bb-a14c-f848aafc497b req-abeefd10-bae9-4507-b04f-57b89637fe3f service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state active and task_state rescuing.
Oct 20 13:17:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 37df8529-b7d2-4892-a3a5-c83c89e06ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:17:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b1321283-b048-4f9e-b661-a5308c8e9836 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:17:02 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [{"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:17:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:17:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:17:03 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a6b4d0-4638-418f-ac0b-03da4ba37333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:17:03 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ffea4a-d6a1-4fac-ad58-ebbb5c9cd69d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2d557-ae60-4e45-8698-53878b91d4e6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c83e5e-74c5-4a54-8a20-d6b1aa8c7b99]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c87b1a-6629-4150-bba0-011bf175e390]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdwRCSFt'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4935d3-0eca-4a5a-abb2-3df3dde19c9d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f487f-9f1c-4a32-ab04-713cd419fb41]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82112d1-70fe-4c57-aa70-922a0be6e7a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:17:03 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414f31c-1238-4194-ba7a-992cfb6e822c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd67e7db-920b-4939-9314-1b4e035cda59]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:03 user nova-compute[74701]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6566bd3-d6b5-4900-975b-81367376f53b]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:17:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:17:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:17:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:17:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:17:04 user nova-compute[74701]: DEBUG nova.objects.instance [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'flavor' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:17:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:17:04 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:17:04 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:17:04 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:17:04 user nova-compute[74701]:   <serial>7152b709-3534-4f9f-a44d-8495533202dc</serial>
Oct 20 13:17:04 user nova-compute[74701]: </disk>
Oct 20 13:17:04 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:17:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No VIF found with MAC fa:16:3e:db:3b:2b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:17:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-5594202f-61ea-4046-91c8-fd26159aea4c tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.115s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Stashing vm_state: active {{(pid=74701) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:17:08 user nova-compute[74701]: INFO nova.compute.claims [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Claim successful on node user
Oct 20 13:17:08 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating resource usage from migration d4d370b0-ac52-4bc6-9312-f89b39eaca9e
Oct 20 13:17:08 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.424s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:08 user nova-compute[74701]: INFO nova.compute.manager [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Migrating
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:08 user nova-compute[74701]: INFO nova.compute.rpcapi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Starting migrate_disk_and_power_off {{(pid=74701) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:09 user nova-compute[74701]: WARNING nova.compute.manager [req-ac30949a-81e0-4366-b459-974a7dbf2d0e req-f09ab179-11c6-484f-8365-e90c5bab1764 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state active and task_state resize_migrating.
Oct 20 13:17:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:10 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance destroyed successfully.
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffbb1918-8d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61075fa5-2bd7-49c5-93da-0a7aa52fba65) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:10 user nova-compute[74701]: INFO os_vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:17:10 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40a042b-c2d6-4f3e-a0f5-37ca1b16c9e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:17:10 user nova-compute[74701]: No targets found.
Oct 20 13:17:10 user nova-compute[74701]: iSNS:
Oct 20 13:17:10 user nova-compute[74701]: No targets found.
Oct 20 13:17:10 user nova-compute[74701]: STATIC:
Oct 20 13:17:10 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:17:10 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:17:10 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:17:10 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:17:10 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:17:10 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:17:10 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:17:10 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:17:10 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:17:10 user nova-compute[74701]: FIRMWARE:
Oct 20 13:17:10 user nova-compute[74701]: No targets found.
Oct 20 13:17:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:17:10 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:17:10 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20ba3b-245a-430d-abf1-21f0f7468189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3f009-3f70-4e97-82d7-eb1a1295cac8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:10 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:10 user nova-compute[74701]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:10 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:10 user nova-compute[74701]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02f4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd1871-ed3c-4dbf-ad92-fd793fccd993]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e53c0-4e54-4121-a6a5-b2b2f309cbbd]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[625231b6-4527-4609-8d41-6994b91de803]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ae06f-10b8-4b6e-b2cf-ab9f2ecb3ace]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[442988c4-0d98-4b23-bcf6-c7dc803792f2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d407de-5b3c-4400-9540-782d619bfb9f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:17:10 user nova-compute[74701]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:17:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[972985af-7785-4fc4-833d-0d4f8b650842]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== disconnect_volume: return (321ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:17:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_resize/disk /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "cp -r /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_resize/disk /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk" returned: 0 in 0.310s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_resize/disk.info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk.info {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "cp -r /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_resize/disk.info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk.info" returned: 0 in 0.044s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:11 user nova-compute[74701]: WARNING nova.compute.manager [req-0d25af87-d4bd-4f8c-b22e-a488528c44ee req-fbf005d1-3f3c-4d9e-9f05-d9d5a23b1b66 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state active and task_state resize_migrating.
Oct 20 13:17:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 binding to destination host user is already ACTIVE {{(pid=74701) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 13:17:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.utils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf3a57f-235c-4651-b13b-952ef39cfc4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e74d6b-8a27-48ca-ade4-650115ba4098]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b0c24-2c6c-425f-8035-88297cb39fe8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a314d-8645-4aa8-8805-2fafe59ec7be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:17:13 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:17:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1821e3d-898d-471f-a6bb-ea9a2288900e]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:17:13 user nova-compute[74701]: DEBUG os_brick.utils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:17:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:17:25 user nova-compute[74701]: INFO nova.compute.claims [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Claim successful on node user
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:17:25 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:17:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.policy [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7973d8d54c1547f5bf177716846a0c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9545edc04414abcd71cd706bd7b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:17:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Creating image(s)
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "/opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "/opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk 1073741824" returned: 0 in 0.058s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Successfully created port: b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Cannot resize image /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Ensure instance console log exists: /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Successfully updated port: b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquired lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-changed-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Refreshing instance network info cache due to event network-changed-b7ee5d8c-7282-40a3-9ce2-eff710b79154. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] Acquiring lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Updating instance_info_cache with network_info: [{"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Releasing lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Instance network_info: |[{"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] Acquired lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Refreshing network info cache for port b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Start _get_guest_xml network_info=[{"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:17:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-609704530',display_name='tempest-DeleteServersTestJSON-server-609704530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-609704530',id=26,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df9545edc04414abcd71cd706bd7b99',ramdisk_id='',reservation_id='r-193kb0l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1901288561',owner_user_name='tempest-DeleteServersTestJSON-1901288561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:26Z,user_data=None,user_id='7973d8d54c1547f5bf177716846a0c1e',uuid=4c494a9c-1c37-4ade-9d49-da3f29308ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converting VIF {"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c494a9c-1c37-4ade-9d49-da3f29308ead {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:17:28 user nova-compute[74701]:   <uuid>4c494a9c-1c37-4ade-9d49-da3f29308ead</uuid>
Oct 20 13:17:28 user nova-compute[74701]:   <name>instance-0000001a</name>
Oct 20 13:17:28 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:17:28 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:17:28 user nova-compute[74701]:   <metadata>
Oct 20 13:17:28 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:17:28 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:name>tempest-DeleteServersTestJSON-server-609704530</nova:name>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:17:28</nova:creationTime>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:17:28 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:17:28 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:owner>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:user uuid="7973d8d54c1547f5bf177716846a0c1e">tempest-DeleteServersTestJSON-1901288561-project-member</nova:user>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:project uuid="1df9545edc04414abcd71cd706bd7b99">tempest-DeleteServersTestJSON-1901288561</nova:project>
Oct 20 13:17:28 user nova-compute[74701]:       </nova:owner>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:17:28 user nova-compute[74701]:       <nova:ports>
Oct 20 13:17:28 user nova-compute[74701]:         <nova:port uuid="b7ee5d8c-7282-40a3-9ce2-eff710b79154">
Oct 20 13:17:28 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 13:17:28 user nova-compute[74701]:         </nova:port>
Oct 20 13:17:28 user nova-compute[74701]:       </nova:ports>
Oct 20 13:17:28 user nova-compute[74701]:     </nova:instance>
Oct 20 13:17:28 user nova-compute[74701]:   </metadata>
Oct 20 13:17:28 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:17:28 user nova-compute[74701]:     <system>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="serial">4c494a9c-1c37-4ade-9d49-da3f29308ead</entry>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="uuid">4c494a9c-1c37-4ade-9d49-da3f29308ead</entry>
Oct 20 13:17:28 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:17:28 user nova-compute[74701]:     </system>
Oct 20 13:17:28 user nova-compute[74701]:   </sysinfo>
Oct 20 13:17:28 user nova-compute[74701]:   <os>
Oct 20 13:17:28 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:17:28 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:17:28 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:17:28 user nova-compute[74701]:   </os>
Oct 20 13:17:28 user nova-compute[74701]:   <features>
Oct 20 13:17:28 user nova-compute[74701]:     <acpi/>
Oct 20 13:17:28 user nova-compute[74701]:     <apic/>
Oct 20 13:17:28 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:17:28 user nova-compute[74701]:   </features>
Oct 20 13:17:28 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:17:28 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:17:28 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:17:28 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:17:28 user nova-compute[74701]:   </clock>
Oct 20 13:17:28 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:17:28 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:17:28 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:17:28 user nova-compute[74701]:   </cpu>
Oct 20 13:17:28 user nova-compute[74701]:   <devices>
Oct 20 13:17:28 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:17:28 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:17:28 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk"/>
Oct 20 13:17:28 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:17:28 user nova-compute[74701]:     </disk>
Oct 20 13:17:28 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:17:28 user nova-compute[74701]:       <mac address="fa:16:3e:83:a3:b7"/>
Oct 20 13:17:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:28 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:17:28 user nova-compute[74701]:       <target dev="tapb7ee5d8c-72"/>
Oct 20 13:17:28 user nova-compute[74701]:     </interface>
Oct 20 13:17:28 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:17:28 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/console.log" append="off"/>
Oct 20 13:17:28 user nova-compute[74701]:     </serial>
Oct 20 13:17:28 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:17:28 user nova-compute[74701]:     <video>
Oct 20 13:17:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:28 user nova-compute[74701]:     </video>
Oct 20 13:17:28 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:17:28 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:17:28 user nova-compute[74701]:     </rng>
Oct 20 13:17:28 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:17:28 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:17:28 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:17:28 user nova-compute[74701]:     </memballoon>
Oct 20 13:17:28 user nova-compute[74701]:   </devices>
Oct 20 13:17:28 user nova-compute[74701]: </domain>
Oct 20 13:17:28 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-609704530',display_name='tempest-DeleteServersTestJSON-server-609704530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-609704530',id=26,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df9545edc04414abcd71cd706bd7b99',ramdisk_id='',reservation_id='r-193kb0l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1901288561',owner_user_name='tempest-DeleteServersTestJSON-1901288561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:26Z,user_data=None,user_id='7973d8d54c1547f5bf177716846a0c1e',uuid=4c494a9c-1c37-4ade-9d49-da3f29308ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converting VIF {"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG os_vif [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '890491b3-fc81-5e1d-8118-c179e3f058f6', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ee5d8c-72, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ee5d8c-72, col_values=(('qos', UUID('2eecc304-8c00-4e95-9fb0-7861438e4b87')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ee5d8c-72, col_values=(('external_ids', {'iface-id': 'b7ee5d8c-7282-40a3-9ce2-eff710b79154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:a3:b7', 'vm-uuid': '4c494a9c-1c37-4ade-9d49-da3f29308ead'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:28 user nova-compute[74701]: INFO os_vif [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72')
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] No VIF found with MAC fa:16:3e:83:a3:b7, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Updated VIF entry in instance network info cache for port b7ee5d8c-7282-40a3-9ce2-eff710b79154. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Updating instance_info_cache with network_info: [{"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f279a372-1dd0-40e9-9fd0-94502c81f772 req-5f575499-dafc-486f-a5c7-7cad53ce0b56 service nova] Releasing lock "refresh_cache-4c494a9c-1c37-4ade-9d49-da3f29308ead" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] No waiting events found dispatching network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:29 user nova-compute[74701]: WARNING nova.compute.manager [req-5f3cd9ae-9fff-4f68-8831-f738db56dcd6 req-4c09e69d-30d6-4c3c-9d1f-31ecbceba904 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received unexpected event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 for instance with vm_state building and task_state spawning.
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:17:30 user nova-compute[74701]: INFO nova.compute.claims [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Claim successful on node user
Oct 20 13:17:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:17:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.policy [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09e73f4fb1c410db0d365d04722a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea6d60f8e654cc2af2ec7085c001ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:17:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Creating image(s)
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "/opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "/opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk 1073741824" returned: 0 in 0.070s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Starting finish_migration {{(pid=74701) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:17:31 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Creating image(s)
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Successfully created port: 5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk. size=21474836480 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Cannot resize image /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Ensure instance console log exists: /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk 21474836480 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk 21474836480" returned: 0 in 0.045s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Ensure instance console log exists: /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start _get_guest_xml network_info=[{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41', 'attached_at': '2023-10-20T13:17:31.000000', 'detached_at': '', 'volume_id': '7152b709-3534-4f9f-a44d-8495533202dc', 'serial': '7152b709-3534-4f9f-a44d-8495533202dc'}, 'attachment_id': '204af8ab-4d3b-4a51-a1e8-7b5a8fc7c7e6', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:17:31 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:31 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] No waiting events found dispatching network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:31 user nova-compute[74701]: WARNING nova.compute.manager [req-7b703655-31b4-41a8-a0b5-f3f8190d4f7e req-5ed9d5e9-3cbe-47a8-8e40-947f255452de service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received unexpected event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 for instance with vm_state building and task_state spawning.
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:17:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:17:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:17:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:17:32 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Instance spawned successfully.
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63eddd0-874a-48fd-ad0d-7a311fb1021a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:17:32 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92e6dd-5776-47e4-9110-5e99ada561dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[add13c76-ab46-4509-acea-cfe6ae120b3d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[58246ff0-c8ce-4cf7-961d-b0f12744e7cc]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: INFO nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8064185-1718-4ac8-8438-ca05afad24d4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdwRCSFt'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[657cabba-dbb3-472b-a7e2-6874df911d88]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Successfully updated port: 5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdcde12-9c25-473b-bb3e-005b3aee705d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquired lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:17:32 user nova-compute[74701]: INFO nova.compute.manager [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Took 6.63 seconds to build instance.
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1f8d6ca4-459f-4156-bcac-d33358414224 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47f9c3b-2f18-4cdc-b9bb-fb922082ac5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:17:32 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2e7996-7769-4512-bdbc-e7226198c97b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5b0d3-b564-4c3a-a06f-f73256b2cae5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:17:32 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:17:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0603828-8490-4289-a2ed-8edd034d56de]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updating instance_info_cache with network_info: [{"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Releasing lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Instance network_info: |[{"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Start _get_guest_xml network_info=[{"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:17:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1473573888',display_name='tempest-AttachVolumeNegativeTest-server-1473573888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1473573888',id=27,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD0gLWmBVnjuDkm/E6RaUjgC83r4k+RTASyBSKIPsURlvxJCZmWzmrM1wGoX0Sdst0GTwgyI9QLW592qYnNBjY/0+2z40EzM+06mZV0mldo7Qr9ECrv6E0Jcvojb/0Zig==',key_name='tempest-keypair-550546839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-u93pgwdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=77f5f2e3-32b1-4954-8df3-39598634d419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'pci_devices' on Instance uuid 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:17:32 user nova-compute[74701]:   <uuid>77f5f2e3-32b1-4954-8df3-39598634d419</uuid>
Oct 20 13:17:32 user nova-compute[74701]:   <name>instance-0000001b</name>
Oct 20 13:17:32 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:17:32 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:17:32 user nova-compute[74701]:   <metadata>
Oct 20 13:17:32 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:17:32 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1473573888</nova:name>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:17:32</nova:creationTime>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:17:32 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:17:32 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:owner>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:user uuid="a09e73f4fb1c410db0d365d04722a4fe">tempest-AttachVolumeNegativeTest-1431718944-project-member</nova:user>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:project uuid="3ea6d60f8e654cc2af2ec7085c001ea1">tempest-AttachVolumeNegativeTest-1431718944</nova:project>
Oct 20 13:17:32 user nova-compute[74701]:       </nova:owner>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:17:32 user nova-compute[74701]:       <nova:ports>
Oct 20 13:17:32 user nova-compute[74701]:         <nova:port uuid="5c5fe535-a978-4893-bb16-7e554e8c1346">
Oct 20 13:17:32 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:17:32 user nova-compute[74701]:         </nova:port>
Oct 20 13:17:32 user nova-compute[74701]:       </nova:ports>
Oct 20 13:17:32 user nova-compute[74701]:     </nova:instance>
Oct 20 13:17:32 user nova-compute[74701]:   </metadata>
Oct 20 13:17:32 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:17:32 user nova-compute[74701]:     <system>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="serial">77f5f2e3-32b1-4954-8df3-39598634d419</entry>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="uuid">77f5f2e3-32b1-4954-8df3-39598634d419</entry>
Oct 20 13:17:32 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:17:32 user nova-compute[74701]:     </system>
Oct 20 13:17:32 user nova-compute[74701]:   </sysinfo>
Oct 20 13:17:32 user nova-compute[74701]:   <os>
Oct 20 13:17:32 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:17:32 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:17:32 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:17:32 user nova-compute[74701]:   </os>
Oct 20 13:17:32 user nova-compute[74701]:   <features>
Oct 20 13:17:32 user nova-compute[74701]:     <acpi/>
Oct 20 13:17:32 user nova-compute[74701]:     <apic/>
Oct 20 13:17:32 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:17:32 user nova-compute[74701]:   </features>
Oct 20 13:17:32 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:17:32 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:17:32 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:17:32 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:17:32 user nova-compute[74701]:   </clock>
Oct 20 13:17:32 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:17:32 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:17:32 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:17:32 user nova-compute[74701]:   </cpu>
Oct 20 13:17:32 user nova-compute[74701]:   <devices>
Oct 20 13:17:32 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:17:32 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:17:32 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk"/>
Oct 20 13:17:32 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:17:32 user nova-compute[74701]:     </disk>
Oct 20 13:17:32 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:17:32 user nova-compute[74701]:       <mac address="fa:16:3e:b7:b2:73"/>
Oct 20 13:17:32 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:32 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:17:32 user nova-compute[74701]:       <target dev="tap5c5fe535-a9"/>
Oct 20 13:17:32 user nova-compute[74701]:     </interface>
Oct 20 13:17:32 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:17:32 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/console.log" append="off"/>
Oct 20 13:17:32 user nova-compute[74701]:     </serial>
Oct 20 13:17:32 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:17:32 user nova-compute[74701]:     <video>
Oct 20 13:17:32 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:32 user nova-compute[74701]:     </video>
Oct 20 13:17:32 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:17:32 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:17:32 user nova-compute[74701]:     </rng>
Oct 20 13:17:32 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:17:32 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:17:32 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:17:32 user nova-compute[74701]:     </memballoon>
Oct 20 13:17:32 user nova-compute[74701]:   </devices>
Oct 20 13:17:32 user nova-compute[74701]: </domain>
Oct 20 13:17:32 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1473573888',display_name='tempest-AttachVolumeNegativeTest-server-1473573888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1473573888',id=27,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD0gLWmBVnjuDkm/E6RaUjgC83r4k+RTASyBSKIPsURlvxJCZmWzmrM1wGoX0Sdst0GTwgyI9QLW592qYnNBjY/0+2z40EzM+06mZV0mldo7Qr9ECrv6E0Jcvojb/0Zig==',key_name='tempest-keypair-550546839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-u93pgwdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=77f5f2e3-32b1-4954-8df3-39598634d419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG os_vif [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03e72dca-708c-50ab-ae95-4074adea34d8', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c5fe535-a9, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c5fe535-a9, col_values=(('qos', UUID('a217ddcd-dc6a-4aaf-986d-644d21ba9b37')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c5fe535-a9, col_values=(('external_ids', {'iface-id': '5c5fe535-a978-4893-bb16-7e554e8c1346', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:b2:73', 'vm-uuid': '77f5f2e3-32b1-4954-8df3-39598634d419'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:32 user nova-compute[74701]: INFO os_vif [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9')
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:b7:b2:73, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:17:33 user nova-compute[74701]:   <uuid>e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</uuid>
Oct 20 13:17:33 user nova-compute[74701]:   <name>instance-00000011</name>
Oct 20 13:17:33 user nova-compute[74701]:   <memory>2097152</memory>
Oct 20 13:17:33 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:17:33 user nova-compute[74701]:   <metadata>
Oct 20 13:17:33 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:17:33 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherB-server-950766450</nova:name>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:17:31</nova:creationTime>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:flavor name="m1.small">
Oct 20 13:17:33 user nova-compute[74701]:         <nova:memory>2048</nova:memory>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:disk>20</nova:disk>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:17:33 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:owner>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:user uuid="f600c832acd2409c973cfa387a018967">tempest-ServerActionsTestOtherB-1560345207-project-member</nova:user>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:project uuid="9321569f0e5b4ca49120669fcd48f80b">tempest-ServerActionsTestOtherB-1560345207</nova:project>
Oct 20 13:17:33 user nova-compute[74701]:       </nova:owner>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:17:33 user nova-compute[74701]:       <nova:ports>
Oct 20 13:17:33 user nova-compute[74701]:         <nova:port uuid="ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4">
Oct 20 13:17:33 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:17:33 user nova-compute[74701]:         </nova:port>
Oct 20 13:17:33 user nova-compute[74701]:       </nova:ports>
Oct 20 13:17:33 user nova-compute[74701]:     </nova:instance>
Oct 20 13:17:33 user nova-compute[74701]:   </metadata>
Oct 20 13:17:33 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:17:33 user nova-compute[74701]:     <system>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="serial">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="uuid">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:17:33 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:17:33 user nova-compute[74701]:     </system>
Oct 20 13:17:33 user nova-compute[74701]:   </sysinfo>
Oct 20 13:17:33 user nova-compute[74701]:   <os>
Oct 20 13:17:33 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:17:33 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:17:33 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:17:33 user nova-compute[74701]:   </os>
Oct 20 13:17:33 user nova-compute[74701]:   <features>
Oct 20 13:17:33 user nova-compute[74701]:     <acpi/>
Oct 20 13:17:33 user nova-compute[74701]:     <apic/>
Oct 20 13:17:33 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:17:33 user nova-compute[74701]:   </features>
Oct 20 13:17:33 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:17:33 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:17:33 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:17:33 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:17:33 user nova-compute[74701]:   </clock>
Oct 20 13:17:33 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:17:33 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:17:33 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:17:33 user nova-compute[74701]:   </cpu>
Oct 20 13:17:33 user nova-compute[74701]:   <devices>
Oct 20 13:17:33 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:17:33 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:17:33 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk"/>
Oct 20 13:17:33 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:17:33 user nova-compute[74701]:     </disk>
Oct 20 13:17:33 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:17:33 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:17:33 user nova-compute[74701]:       <source dev="/dev/sdd"/>
Oct 20 13:17:33 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:17:33 user nova-compute[74701]:       <serial>7152b709-3534-4f9f-a44d-8495533202dc</serial>
Oct 20 13:17:33 user nova-compute[74701]:     </disk>
Oct 20 13:17:33 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:17:33 user nova-compute[74701]:       <mac address="fa:16:3e:db:3b:2b"/>
Oct 20 13:17:33 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:33 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:17:33 user nova-compute[74701]:       <target dev="tapffbb1918-8d"/>
Oct 20 13:17:33 user nova-compute[74701]:     </interface>
Oct 20 13:17:33 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:17:33 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/console.log" append="off"/>
Oct 20 13:17:33 user nova-compute[74701]:     </serial>
Oct 20 13:17:33 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:17:33 user nova-compute[74701]:     <video>
Oct 20 13:17:33 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:17:33 user nova-compute[74701]:     </video>
Oct 20 13:17:33 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:17:33 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:17:33 user nova-compute[74701]:     </rng>
Oct 20 13:17:33 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:17:33 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:17:33 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:17:33 user nova-compute[74701]:     </memballoon>
Oct 20 13:17:33 user nova-compute[74701]:   </devices>
Oct 20 13:17:33 user nova-compute[74701]: </domain>
Oct 20 13:17:33 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1077585176-network", "vif_mac": "fa:16:3e:db:3b:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG os_vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb872d2e-b646-5e04-8321-ad2508627898', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffbb1918-8d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffbb1918-8d, col_values=(('qos', UUID('677cda41-16b0-431e-b0cf-5d03779a86f8')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffbb1918-8d, col_values=(('external_ids', {'iface-id': 'ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3b:2b', 'vm-uuid': 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:33 user nova-compute[74701]: INFO os_vif [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:17:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] No VIF found with MAC fa:16:3e:db:3b:2b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-changed-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Refreshing instance network info cache due to event network-changed-5c5fe535-a978-4893-bb16-7e554e8c1346. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] Acquiring lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] Acquired lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.network.neutron [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Refreshing network info cache for port 5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.network.neutron [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updated VIF entry in instance network info cache for port 5c5fe535-a978-4893-bb16-7e554e8c1346. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.network.neutron [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updating instance_info_cache with network_info: [{"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed00e32c-ed3a-4ef0-bbff-34b9e04a07dd req-867d2ae8-a493-482a-acec-825316d44028 service nova] Releasing lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:34 user nova-compute[74701]: WARNING nova.compute.manager [req-2c2bd75f-bf3f-434a-bb17-1e34a152eef5 req-2659a98a-a89e-41f8-ba0d-cd46be525d86 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state building and task_state spawning.
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:36 user nova-compute[74701]: WARNING nova.compute.manager [req-e4423492-fc1e-4af3-a0aa-a294cb1c93f7 req-4d12ec99-26bd-47b0-baaa-98c2f70c054a service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state active and task_state resize_finish.
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:36 user nova-compute[74701]: WARNING nova.compute.manager [req-6b84867a-a090-4515-8ffb-a2d421e856a8 req-a1e3b290-2c27-4962-8b98-fbbf622a398c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state building and task_state spawning.
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:17:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Instance spawned successfully.
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:17:37 user nova-compute[74701]: INFO nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Took 6.73 seconds to spawn the instance on the hypervisor.
Oct 20 13:17:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:17:37 user nova-compute[74701]: INFO nova.compute.manager [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Took 7.53 seconds to build instance.
Oct 20 13:17:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bac7856f-bb9c-4700-889c-1de8e7d6f863 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.651s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:17:38 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance running successfully.
Oct 20 13:17:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Failed to set time: agent not configured {{(pid=74701) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6319a15d-0c1d-4074-9667-1eabdf542704 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] finish_migration finished successfully. {{(pid=74701) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:38 user nova-compute[74701]: WARNING nova.compute.manager [req-cb0057f1-4080-4967-bf13-f51fed76435e req-9f2d6a0d-7e73-4eb1-9da6-3650ef65abaf service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state active and task_state resize_finish.
Oct 20 13:17:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:41 user nova-compute[74701]: INFO nova.compute.manager [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Terminating instance
Oct 20 13:17:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:42 user nova-compute[74701]: INFO nova.compute.manager [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Unshelving
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: INFO nova.virt.block_device [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Booting with volume d5369e9a-0724-48d5-b226-ff01b0f2cd8d at /dev/vdc
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.utils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-unplugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] No waiting events found dispatching network-vif-unplugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-28c2d9d1-d5fb-4114-878d-0aaf4e0343fd req-0d754cd4-3ac3-4a81-9810-b56f3bdd8560 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-unplugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e4c14-adf1-4112-ad72-9f73d4ec5eb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016f750-5661-48af-b061-006fcb59f9ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855232f-3450-4cd9-8672-ec91466f76b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff7dc5-d326-475c-b68b-35ca0bdd138b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:17:42 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:17:42 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eefc2a-e6e4-41c1-8d3f-e18634889f3f]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_brick.utils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating existing volume attachment record: 56538903-d5ab-49b9-b241-14ea2dfde584 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Instance destroyed successfully.
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lazy-loading 'resources' on Instance uuid 37df8529-b7d2-4892-a3a5-c83c89e06ddd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761126974',display_name='tempest-VolumesActionsTest-instance-1761126974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761126974',id=25,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-autkndf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:15:58Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=37df8529-b7d2-4892-a3a5-c83c89e06ddd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "address": "fa:16:3e:af:2e:64", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53a6fb0-e8", "ovs_interfaceid": "e53a6fb0-e81f-4853-af3e-e2b6f45d956e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG os_vif [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape53a6fb0-e8, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b134290-46b2-45a9-9bda-f016836871eb) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:17:42 user nova-compute[74701]: INFO os_vif [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:64,bridge_name='br-int',has_traffic_filtering=True,id=e53a6fb0-e81f-4853-af3e-e2b6f45d956e,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53a6fb0-e8')
Oct 20 13:17:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Deleting instance files /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd_del
Oct 20 13:17:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Deletion of /opt/stack/data/nova/instances/37df8529-b7d2-4892-a3a5-c83c89e06ddd_del complete
Oct 20 13:17:43 user nova-compute[74701]: INFO nova.compute.manager [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 13:17:43 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:17:43 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:17:43 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:17:43 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:17:43 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Took 0.68 seconds to deallocate network for instance.
Oct 20 13:17:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:44 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Deleted allocations for instance 37df8529-b7d2-4892-a3a5-c83c89e06ddd
Oct 20 13:17:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] Acquiring lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] No waiting events found dispatching network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:17:44 user nova-compute[74701]: WARNING nova.compute.manager [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received unexpected event network-vif-plugged-e53a6fb0-e81f-4853-af3e-e2b6f45d956e for instance with vm_state deleted and task_state None.
Oct 20 13:17:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-854a38bb-1dbb-40e4-889f-cfe7a853c5de req-dad3e559-3b8a-4569-aab7-bdb9ad8eb424 service nova] [instance: 37df8529-b7d2-4892-a3a5-c83c89e06ddd] Received event network-vif-deleted-e53a6fb0-e81f-4853-af3e-e2b6f45d956e {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:17:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7c354870-2fe5-4ef4-b30f-fbe2fea82010 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "37df8529-b7d2-4892-a3a5-c83c89e06ddd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:17:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:17:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:17:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_requests' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'numa_topology' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:18:01 user nova-compute[74701]: INFO nova.compute.claims [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Claim successful on node user
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:01 user nova-compute[74701]: INFO nova.network.neutron [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:02 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:02 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.021595001220703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Applying migration context for instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 as it has an incoming, in-progress migration d4d370b0-ac52-4bc6-9312-f89b39eaca9e. Migration status is finished {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 13:18:03 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating resource usage from migration d4d370b0-ac52-4bc6-9312-f89b39eaca9e
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Migration d4d370b0-ac52-4bc6-9312-f89b39eaca9e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c494a9c-1c37-4ade-9d49-da3f29308ead actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 77f5f2e3-32b1-4954-8df3-39598634d419 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (40b83711-652c-474c-aa9f-09e010a7f984): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing instance network info cache due to event network-changed-119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] Acquiring lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:18:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Creating image(s)
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'trusted_certs' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] Acquired lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Refreshing network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.objects.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<39db995b-5a3b-4077-97fc-81996bb88dd8> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "d63de64a61e980382d4fdeee383c4df75cb44897" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "d63de64a61e980382d4fdeee383c4df75cb44897" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:18:03 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.672s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG nova.virt.images [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] c6ef99a0-fcb1-4f58-ba26-13e9478237f1 was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.part /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updated VIF entry in instance network info cache for port 119c01dd-e22d-4d3d-a529-b1a16a01f9a8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-18f013ad-1daa-45cd-b89c-17e667d7417e req-6e8ab3ac-9396-48ba-a866-13492c70c65b service nova] Releasing lock "refresh_cache-39db995b-5a3b-4077-97fc-81996bb88dd8" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.part /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.converted" returned: 0 in 0.566s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "d63de64a61e980382d4fdeee383c4df75cb44897" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.148s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "d63de64a61e980382d4fdeee383c4df75cb44897" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "d63de64a61e980382d4fdeee383c4df75cb44897" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897,backing_fmt=raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897,backing_fmt=raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk 1073741824" returned: 0 in 0.046s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "d63de64a61e980382d4fdeee383c4df75cb44897" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'migration_context' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG nova.objects.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<39db995b-5a3b-4077-97fc-81996bb88dd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:18:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Rebasing disk image.
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b -F raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [{"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-0fd5f037-78df-4001-97b6-d4fec57b87d5" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:18:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b -F raw /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk" returned: 0 in 2.511s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Ensure instance console log exists: /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start _get_guest_xml network_info=[{"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='66a32b46ba254b7390985191f01302a6',container_format='bare',created_at=2023-10-20T13:15:50Z,direct_url=<?>,disk_format='qcow2',id=c6ef99a0-fcb1-4f58-ba26-13e9478237f1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1514932320-shelved',owner='eaf15939da12479f9c7bfff1c4198efe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:15:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbOBgTkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '39db995b-5a3b-4077-97fc-81996bb88dd8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5369e9a-0724-48d5-b226-ff01b0f2cd8d', 'serial': 'd5369e9a-0724-48d5-b226-ff01b0f2cd8d'}, 'attachment_id': '56538903-d5ab-49b9-b241-14ea2dfde584', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:18:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='66a32b46ba254b7390985191f01302a6',container_format='bare',created_at=2023-10-20T13:15:50Z,direct_url=<?>,disk_format='qcow2',id=c6ef99a0-fcb1-4f58-ba26-13e9478237f1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1514932320-shelved',owner='eaf15939da12479f9c7bfff1c4198efe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:15:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.objects.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<39db995b-5a3b-4077-97fc-81996bb88dd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbOBgTkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:18:08 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:18:08 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:18:08 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d730367b-e3fd-4c15-ba86-be36c399632b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:18:08 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4434a6-de66-44e7-9435-383627fbcfec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d] added
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd341f0-1513-4952-9a38-eedfe35c4399]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de56d5-16f7-4928-bd73-fa209a8b01ac]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbOBgTkc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbOBgTkc" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[025bcd06-5e40-4c96-8a9f-e0506ea7ab41]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbOBgTkc'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4612a-1be2-40ea-b706-af07fc0787db]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9227695-a77a-49a4-ada6-ea012c30fd43]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce95ef36-bc11-4225-880c-f113ab6f871b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260]
Oct 20 13:18:09 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260] successful.
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad977dc-442f-4f60-92fa-45730a80fe98]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da73bdc-0a83-4fe6-867d-3fa4371a9aea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:09 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:18:09 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac5016-a16e-4471-ab9b-84ecb9b3cdab]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:09 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:18:10 user nova-compute[74701]: INFO nova.compute.claims [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Claim successful on node user
Oct 20 13:18:10 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbOBgTkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26435626637386162', 'path': '/dev/sde'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435626637386162', 'path': '/dev/sde'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='c6ef99a0-fcb1-4f58-ba26-13e9478237f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-704380112',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:15:53.838939',shelved_host='user',shelved_image_id='c6ef99a0-fcb1-4f58-ba26-13e9478237f1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_devices' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.objects.base [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<39db995b-5a3b-4077-97fc-81996bb88dd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:18:10 user nova-compute[74701]:   <uuid>39db995b-5a3b-4077-97fc-81996bb88dd8</uuid>
Oct 20 13:18:10 user nova-compute[74701]:   <name>instance-00000013</name>
Oct 20 13:18:10 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:18:10 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:18:10 user nova-compute[74701]:   <metadata>
Oct 20 13:18:10 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:18:10 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1514932320</nova:name>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:18:08</nova:creationTime>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:18:10 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:18:10 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:owner>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:user uuid="22371d97e6c1416499916660b5b2b07e">tempest-AttachVolumeShelveTestJSON-1805146529-project-member</nova:user>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:project uuid="eaf15939da12479f9c7bfff1c4198efe">tempest-AttachVolumeShelveTestJSON-1805146529</nova:project>
Oct 20 13:18:10 user nova-compute[74701]:       </nova:owner>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:root type="image" uuid="c6ef99a0-fcb1-4f58-ba26-13e9478237f1"/>
Oct 20 13:18:10 user nova-compute[74701]:       <nova:ports>
Oct 20 13:18:10 user nova-compute[74701]:         <nova:port uuid="119c01dd-e22d-4d3d-a529-b1a16a01f9a8">
Oct 20 13:18:10 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:18:10 user nova-compute[74701]:         </nova:port>
Oct 20 13:18:10 user nova-compute[74701]:       </nova:ports>
Oct 20 13:18:10 user nova-compute[74701]:     </nova:instance>
Oct 20 13:18:10 user nova-compute[74701]:   </metadata>
Oct 20 13:18:10 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:18:10 user nova-compute[74701]:     <system>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="serial">39db995b-5a3b-4077-97fc-81996bb88dd8</entry>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="uuid">39db995b-5a3b-4077-97fc-81996bb88dd8</entry>
Oct 20 13:18:10 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:18:10 user nova-compute[74701]:     </system>
Oct 20 13:18:10 user nova-compute[74701]:   </sysinfo>
Oct 20 13:18:10 user nova-compute[74701]:   <os>
Oct 20 13:18:10 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:18:10 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:18:10 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:18:10 user nova-compute[74701]:   </os>
Oct 20 13:18:10 user nova-compute[74701]:   <features>
Oct 20 13:18:10 user nova-compute[74701]:     <acpi/>
Oct 20 13:18:10 user nova-compute[74701]:     <apic/>
Oct 20 13:18:10 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:18:10 user nova-compute[74701]:   </features>
Oct 20 13:18:10 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:18:10 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:18:10 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:18:10 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:18:10 user nova-compute[74701]:   </clock>
Oct 20 13:18:10 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:18:10 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:18:10 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:18:10 user nova-compute[74701]:   </cpu>
Oct 20 13:18:10 user nova-compute[74701]:   <devices>
Oct 20 13:18:10 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:18:10 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:18:10 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk"/>
Oct 20 13:18:10 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:18:10 user nova-compute[74701]:     </disk>
Oct 20 13:18:10 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:18:10 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:18:10 user nova-compute[74701]:       <source dev="/dev/sde"/>
Oct 20 13:18:10 user nova-compute[74701]:       <target dev="vdc" bus="virtio"/>
Oct 20 13:18:10 user nova-compute[74701]:       <serial>d5369e9a-0724-48d5-b226-ff01b0f2cd8d</serial>
Oct 20 13:18:10 user nova-compute[74701]:     </disk>
Oct 20 13:18:10 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:18:10 user nova-compute[74701]:       <mac address="fa:16:3e:17:a3:23"/>
Oct 20 13:18:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:10 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:18:10 user nova-compute[74701]:       <target dev="tap119c01dd-e2"/>
Oct 20 13:18:10 user nova-compute[74701]:     </interface>
Oct 20 13:18:10 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:18:10 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/console.log" append="off"/>
Oct 20 13:18:10 user nova-compute[74701]:     </serial>
Oct 20 13:18:10 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:18:10 user nova-compute[74701]:     <video>
Oct 20 13:18:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:10 user nova-compute[74701]:     </video>
Oct 20 13:18:10 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:18:10 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:18:10 user nova-compute[74701]:     </rng>
Oct 20 13:18:10 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:18:10 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:18:10 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:18:10 user nova-compute[74701]:     </memballoon>
Oct 20 13:18:10 user nova-compute[74701]:   </devices>
Oct 20 13:18:10 user nova-compute[74701]: </domain>
Oct 20 13:18:10 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='c6ef99a0-fcb1-4f58-ba26-13e9478237f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-704380112',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:15:53.838939',shelved_host='user',shelved_image_id='c6ef99a0-fcb1-4f58-ba26-13e9478237f1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG os_vif [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c4c8977-8a47-54f4-81c8-514e14507616', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap119c01dd-e2, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap119c01dd-e2, col_values=(('qos', UUID('266ed708-7f93-4886-9122-ce04c16edc45')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap119c01dd-e2, col_values=(('external_ids', {'iface-id': '119c01dd-e22d-4d3d-a529-b1a16a01f9a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:a3:23', 'vm-uuid': '39db995b-5a3b-4077-97fc-81996bb88dd8'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:10 user nova-compute[74701]: INFO os_vif [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2')
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No VIF found with MAC fa:16:3e:17:a3:23, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.767s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:18:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.policy [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9189507d4d4f4faeb52d1f6b1fcb17d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0182e44f51fb425c8cd560e7a42da61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:18:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Creating image(s)
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "/opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "/opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "/opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.233s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.273s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk 1073741824" returned: 0 in 0.126s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.421s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Successfully created port: 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Cannot resize image /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Ensure instance console log exists: /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:12 user nova-compute[74701]: WARNING nova.compute.manager [req-2cb299b6-2897-4ea4-ab7d-ac7d45c039f5 req-86fc28be-0c7a-4c59-95fb-d3151af56121 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Successfully updated port: 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-changed-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Refreshing instance network info cache due to event network-changed-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] Acquiring lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updating instance_info_cache with network_info: [{"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Instance network_info: |[{"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] Acquired lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Refreshing network info cache for port 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Start _get_guest_xml network_info=[{"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:18:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420456836',display_name='tempest-tempest.common.compute-instance-1420456836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420456836',id=28,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXU6y6tFNGHTPacKZJCgIUu+ngKQu+rkfpzKy+M1MSHL+tA4yZj9LV7CJTyXaI1PGK/FK8cd10U+Bx+q3VgxGYsgBiM36QXuY9ApleSRHI/I3hOwYwy4S+EVbY2E8Gx+w==',key_name='tempest-keypair-754126478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-dr6e0lv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=372102fa-399b-4ae2-8c73-23b250e4d790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'pci_devices' on Instance uuid 372102fa-399b-4ae2-8c73-23b250e4d790 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:18:13 user nova-compute[74701]:   <uuid>372102fa-399b-4ae2-8c73-23b250e4d790</uuid>
Oct 20 13:18:13 user nova-compute[74701]:   <name>instance-0000001c</name>
Oct 20 13:18:13 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:18:13 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:18:13 user nova-compute[74701]:   <metadata>
Oct 20 13:18:13 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:18:13 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:name>tempest-tempest.common.compute-instance-1420456836</nova:name>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:18:13</nova:creationTime>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:18:13 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:18:13 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:owner>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:user uuid="9189507d4d4f4faeb52d1f6b1fcb17d8">tempest-ServerActionsTestOtherA-1694438458-project-member</nova:user>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:project uuid="0182e44f51fb425c8cd560e7a42da61f">tempest-ServerActionsTestOtherA-1694438458</nova:project>
Oct 20 13:18:13 user nova-compute[74701]:       </nova:owner>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:18:13 user nova-compute[74701]:       <nova:ports>
Oct 20 13:18:13 user nova-compute[74701]:         <nova:port uuid="383ceab8-ce75-4ada-8fff-ea65fbe8e7ca">
Oct 20 13:18:13 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:18:13 user nova-compute[74701]:         </nova:port>
Oct 20 13:18:13 user nova-compute[74701]:       </nova:ports>
Oct 20 13:18:13 user nova-compute[74701]:     </nova:instance>
Oct 20 13:18:13 user nova-compute[74701]:   </metadata>
Oct 20 13:18:13 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:18:13 user nova-compute[74701]:     <system>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="serial">372102fa-399b-4ae2-8c73-23b250e4d790</entry>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="uuid">372102fa-399b-4ae2-8c73-23b250e4d790</entry>
Oct 20 13:18:13 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:18:13 user nova-compute[74701]:     </system>
Oct 20 13:18:13 user nova-compute[74701]:   </sysinfo>
Oct 20 13:18:13 user nova-compute[74701]:   <os>
Oct 20 13:18:13 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:18:13 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:18:13 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:18:13 user nova-compute[74701]:   </os>
Oct 20 13:18:13 user nova-compute[74701]:   <features>
Oct 20 13:18:13 user nova-compute[74701]:     <acpi/>
Oct 20 13:18:13 user nova-compute[74701]:     <apic/>
Oct 20 13:18:13 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:18:13 user nova-compute[74701]:   </features>
Oct 20 13:18:13 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:18:13 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:18:13 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:18:13 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:18:13 user nova-compute[74701]:   </clock>
Oct 20 13:18:13 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:18:13 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:18:13 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:18:13 user nova-compute[74701]:   </cpu>
Oct 20 13:18:13 user nova-compute[74701]:   <devices>
Oct 20 13:18:13 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:18:13 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:18:13 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk"/>
Oct 20 13:18:13 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:18:13 user nova-compute[74701]:     </disk>
Oct 20 13:18:13 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:18:13 user nova-compute[74701]:       <mac address="fa:16:3e:65:42:34"/>
Oct 20 13:18:13 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:13 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:18:13 user nova-compute[74701]:       <target dev="tap383ceab8-ce"/>
Oct 20 13:18:13 user nova-compute[74701]:     </interface>
Oct 20 13:18:13 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:18:13 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/console.log" append="off"/>
Oct 20 13:18:13 user nova-compute[74701]:     </serial>
Oct 20 13:18:13 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:18:13 user nova-compute[74701]:     <video>
Oct 20 13:18:13 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:13 user nova-compute[74701]:     </video>
Oct 20 13:18:13 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:18:13 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:18:13 user nova-compute[74701]:     </rng>
Oct 20 13:18:13 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:18:13 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:18:13 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:18:13 user nova-compute[74701]:     </memballoon>
Oct 20 13:18:13 user nova-compute[74701]:   </devices>
Oct 20 13:18:13 user nova-compute[74701]: </domain>
Oct 20 13:18:13 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420456836',display_name='tempest-tempest.common.compute-instance-1420456836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420456836',id=28,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXU6y6tFNGHTPacKZJCgIUu+ngKQu+rkfpzKy+M1MSHL+tA4yZj9LV7CJTyXaI1PGK/FK8cd10U+Bx+q3VgxGYsgBiM36QXuY9ApleSRHI/I3hOwYwy4S+EVbY2E8Gx+w==',key_name='tempest-keypair-754126478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-dr6e0lv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=372102fa-399b-4ae2-8c73-23b250e4d790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG os_vif [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b58a694-65ab-5062-81ca-5ddf7c1210d4', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap383ceab8-ce, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap383ceab8-ce, col_values=(('qos', UUID('d3520eca-fc2e-4714-9fe0-54628dd9ffd9')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap383ceab8-ce, col_values=(('external_ids', {'iface-id': '383ceab8-ce75-4ada-8fff-ea65fbe8e7ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:42:34', 'vm-uuid': '372102fa-399b-4ae2-8c73-23b250e4d790'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:13 user nova-compute[74701]: INFO os_vif [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce')
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No VIF found with MAC fa:16:3e:65:42:34, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updated VIF entry in instance network info cache for port 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG nova.network.neutron [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updating instance_info_cache with network_info: [{"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d0dc0168-6dd6-478a-85a5-838f712297ef req-4fb04519-2e0a-46f8-999b-80441056c2df service nova] Releasing lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:14 user nova-compute[74701]: WARNING nova.compute.manager [req-b69b5a91-69b3-4d2c-a05f-3e8898dbea79 req-c08941f9-d4ea-48f1-b652-a743635bf01e service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance spawned successfully.
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b9920e68-e3d3-4df0-8e5f-2242de67cf12 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] No waiting events found dispatching network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:15 user nova-compute[74701]: WARNING nova.compute.manager [req-015ddd0c-6e57-4770-9f1e-bd0a68d87018 req-6c953d01-b13c-44b2-948c-8d349c1c003b service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received unexpected event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca for instance with vm_state building and task_state spawning.
Oct 20 13:18:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:18:16 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Instance spawned successfully.
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:18:16 user nova-compute[74701]: INFO nova.compute.manager [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Unrescuing
Oct 20 13:18:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:17 user nova-compute[74701]: INFO nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 20 13:18:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:18:17 user nova-compute[74701]: INFO nova.compute.manager [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Took 7.01 seconds to build instance.
Oct 20 13:18:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] No waiting events found dispatching network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:17 user nova-compute[74701]: WARNING nova.compute.manager [req-cc105f50-c4f7-478e-b1cc-4d41652312e0 req-d2807fd2-c1c0-477c-bac0-53c5df15ddfb service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received unexpected event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca for instance with vm_state active and task_state None.
Oct 20 13:18:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b314f12d-457d-4554-8c74-1c4c8854ce2b tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.117s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'flavor' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance destroyed successfully.
Oct 20 13:18:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:19 user nova-compute[74701]: WARNING nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:19 user nova-compute[74701]: WARNING nova.compute.manager [req-a750a51a-7fc0-4d51-b78e-4d6988869743 req-a70f5123-f9e6-472d-8624-736cc7a0b20f service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:21 user nova-compute[74701]: WARNING nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:21 user nova-compute[74701]: WARNING nova.compute.manager [req-f0b6e591-ce97-41d1-8eab-baa74c3700f1 req-2dc56f89-cae7-41a0-a0af-be2e3434f7ad service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bd7a28f5-914d-4fa0-9c6e-f1c1db7aebad tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:18:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:33 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:18:33 user nova-compute[74701]: INFO nova.compute.claims [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Claim successful on node user
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:18:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.policy [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5447da7d31cf44ba84c5836599970f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73abb7994b4ce1b83d9d35b4a5e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:18:34 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Creating image(s)
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "/opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "/opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "/opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.274s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk 1073741824" returned: 0 in 0.064s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Successfully created port: 7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Cannot resize image /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Ensure instance console log exists: /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Successfully updated port: 7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquired lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-changed-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Refreshing instance network info cache due to event network-changed-7a9220de-83c2-4c6c-b0c1-115dc3a41a79. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] Acquiring lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Updating instance_info_cache with network_info: [{"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Releasing lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Instance network_info: |[{"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] Acquired lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.neutron [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Refreshing network info cache for port 7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Start _get_guest_xml network_info=[{"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:18:36 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:36 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2013073953',display_name='tempest-VolumesActionsTest-instance-2013073953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2013073953',id=29,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-zd9z28y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:18:35Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=9df84e89-a68c-4d6d-a80f-7ed88f92a50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df84e89-a68c-4d6d-a80f-7ed88f92a50d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:18:36 user nova-compute[74701]:   <uuid>9df84e89-a68c-4d6d-a80f-7ed88f92a50d</uuid>
Oct 20 13:18:36 user nova-compute[74701]:   <name>instance-0000001d</name>
Oct 20 13:18:36 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:18:36 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:18:36 user nova-compute[74701]:   <metadata>
Oct 20 13:18:36 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:18:36 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:name>tempest-VolumesActionsTest-instance-2013073953</nova:name>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:18:36</nova:creationTime>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:18:36 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:18:36 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:owner>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:user uuid="5447da7d31cf44ba84c5836599970f3d">tempest-VolumesActionsTest-1955537551-project-member</nova:user>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:project uuid="0b73abb7994b4ce1b83d9d35b4a5e272">tempest-VolumesActionsTest-1955537551</nova:project>
Oct 20 13:18:36 user nova-compute[74701]:       </nova:owner>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:18:36 user nova-compute[74701]:       <nova:ports>
Oct 20 13:18:36 user nova-compute[74701]:         <nova:port uuid="7a9220de-83c2-4c6c-b0c1-115dc3a41a79">
Oct 20 13:18:36 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 13:18:36 user nova-compute[74701]:         </nova:port>
Oct 20 13:18:36 user nova-compute[74701]:       </nova:ports>
Oct 20 13:18:36 user nova-compute[74701]:     </nova:instance>
Oct 20 13:18:36 user nova-compute[74701]:   </metadata>
Oct 20 13:18:36 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:18:36 user nova-compute[74701]:     <system>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="serial">9df84e89-a68c-4d6d-a80f-7ed88f92a50d</entry>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="uuid">9df84e89-a68c-4d6d-a80f-7ed88f92a50d</entry>
Oct 20 13:18:36 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:18:36 user nova-compute[74701]:     </system>
Oct 20 13:18:36 user nova-compute[74701]:   </sysinfo>
Oct 20 13:18:36 user nova-compute[74701]:   <os>
Oct 20 13:18:36 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:18:36 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:18:36 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:18:36 user nova-compute[74701]:   </os>
Oct 20 13:18:36 user nova-compute[74701]:   <features>
Oct 20 13:18:36 user nova-compute[74701]:     <acpi/>
Oct 20 13:18:36 user nova-compute[74701]:     <apic/>
Oct 20 13:18:36 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:18:36 user nova-compute[74701]:   </features>
Oct 20 13:18:36 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:18:36 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:18:36 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:18:36 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:18:36 user nova-compute[74701]:   </clock>
Oct 20 13:18:36 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:18:36 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:18:36 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:18:36 user nova-compute[74701]:   </cpu>
Oct 20 13:18:36 user nova-compute[74701]:   <devices>
Oct 20 13:18:36 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:18:36 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:18:36 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk"/>
Oct 20 13:18:36 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:18:36 user nova-compute[74701]:     </disk>
Oct 20 13:18:36 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:18:36 user nova-compute[74701]:       <mac address="fa:16:3e:fe:4c:f6"/>
Oct 20 13:18:36 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:36 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:18:36 user nova-compute[74701]:       <target dev="tap7a9220de-83"/>
Oct 20 13:18:36 user nova-compute[74701]:     </interface>
Oct 20 13:18:36 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:18:36 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/console.log" append="off"/>
Oct 20 13:18:36 user nova-compute[74701]:     </serial>
Oct 20 13:18:36 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:18:36 user nova-compute[74701]:     <video>
Oct 20 13:18:36 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:18:36 user nova-compute[74701]:     </video>
Oct 20 13:18:36 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:18:36 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:18:36 user nova-compute[74701]:     </rng>
Oct 20 13:18:36 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:18:36 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:18:36 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:18:36 user nova-compute[74701]:     </memballoon>
Oct 20 13:18:36 user nova-compute[74701]:   </devices>
Oct 20 13:18:36 user nova-compute[74701]: </domain>
Oct 20 13:18:36 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2013073953',display_name='tempest-VolumesActionsTest-instance-2013073953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2013073953',id=29,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-zd9z28y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:18:35Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=9df84e89-a68c-4d6d-a80f-7ed88f92a50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG os_vif [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9686d01f-7e04-5969-9a0a-f5e5bbd3b29e', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9220de-83, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9220de-83, col_values=(('qos', UUID('704a4bee-212f-4025-bff9-1916866e715a')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9220de-83, col_values=(('external_ids', {'iface-id': '7a9220de-83c2-4c6c-b0c1-115dc3a41a79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:4c:f6', 'vm-uuid': '9df84e89-a68c-4d6d-a80f-7ed88f92a50d'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: INFO os_vif [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83')
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] No VIF found with MAC fa:16:3e:fe:4c:f6, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.neutron [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Updated VIF entry in instance network info cache for port 7a9220de-83c2-4c6c-b0c1-115dc3a41a79. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG nova.network.neutron [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Updating instance_info_cache with network_info: [{"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c2f63e29-0c0b-4c49-a831-9695017c4b69 req-d47e30ae-92e5-43ea-b65d-82133afae2a0 service nova] Releasing lock "refresh_cache-9df84e89-a68c-4d6d-a80f-7ed88f92a50d" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] No waiting events found dispatching network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:38 user nova-compute[74701]: WARNING nova.compute.manager [req-f68132b5-06e6-45e5-b474-448f0f1220b9 req-93bb305a-c69b-478d-b0d5-bfce1f4011c2 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received unexpected event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 for instance with vm_state building and task_state spawning.
Oct 20 13:18:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:18:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:18:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Instance spawned successfully.
Oct 20 13:18:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:18:40 user nova-compute[74701]: INFO nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:40 user nova-compute[74701]: DEBUG nova.compute.manager [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] No waiting events found dispatching network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:40 user nova-compute[74701]: WARNING nova.compute.manager [req-7aba28d0-c423-45cd-8261-f665e7765941 req-1e33f80d-853f-41b3-9a89-f9c507747d4c service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received unexpected event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 for instance with vm_state building and task_state spawning.
Oct 20 13:18:40 user nova-compute[74701]: INFO nova.compute.manager [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Took 6.32 seconds to build instance.
Oct 20 13:18:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6a196eb0-4746-4282-8cfa-70eb5ac4411c tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.432s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:47 user nova-compute[74701]: INFO nova.compute.manager [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Unrescuing
Oct 20 13:18:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'flavor' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:48 user nova-compute[74701]: WARNING nova.compute.manager [req-26b2756f-59e6-41db-80ca-7b64c6067a95 req-5c185ae1-0df6-4e63-b601-c3d27e482066 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance destroyed successfully.
Oct 20 13:18:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:50 user nova-compute[74701]: WARNING nova.compute.manager [req-931efebb-0e46-42fe-919b-672dd8fa980e req-230b7982-4764-4277-9572-db713c3d0949 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-29ff557f-dd0d-4036-b55f-e1cc94687f61 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:52 user nova-compute[74701]: WARNING nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:52 user nova-compute[74701]: WARNING nova.compute.manager [req-27ca4f11-5265-4c1c-ad61-5f94db0ae2e3 req-77e7444f-7b83-4ab9-80fc-1185a996aa40 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:18:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Port ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 binding to destination host user is already ACTIVE {{(pid=74701) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 13:18:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:18:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:18:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Creating tmpfile /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/tmpe5pzjvwj to verify with other compute node that the instance is on the same shared storage. {{(pid=74701) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:18:58 user nova-compute[74701]: WARNING nova.compute.manager [req-5311ae3d-0323-4044-86e7-65fd9864b45e req-dc3b94a0-31ca-4df4-a551-dcde699e9f94 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state resized and task_state resize_reverting.
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:18:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:18:59 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance destroyed successfully.
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'resources' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffbb1918-8d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677cda41-16b0-431e-b0cf-5d03779a86f8) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:18:59 user nova-compute[74701]: INFO os_vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:18:59 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85548aee-7913-4c7c-81a8-d4f2e3baa4a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:18:59 user nova-compute[74701]: No targets found.
Oct 20 13:18:59 user nova-compute[74701]: iSNS:
Oct 20 13:18:59 user nova-compute[74701]: No targets found.
Oct 20 13:18:59 user nova-compute[74701]: STATIC:
Oct 20 13:18:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:18:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:18:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:18:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d
Oct 20 13:18:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:18:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:18:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:18:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:18:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:18:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:18:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:18:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:18:59 user nova-compute[74701]: FIRMWARE:
Oct 20 13:18:59 user nova-compute[74701]: No targets found.
Oct 20 13:18:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:18:59 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:18:59 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e75107a-759b-4cfa-bb99-daf6c2cb1647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648b249-de83-4ec6-bd07-b40db2a08b71]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:18:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:18:59 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:18:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86f82a3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d1277-33b3-47d9-9bb7-16b765d8aaf4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79031e3-e634-4f3a-b61b-1ee27fbcd548]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[997526c0-7117-4211-b316-2ee3bdef0464]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455a9ec-bb2a-41be-a88c-20dbd60ffc2c]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5164a9-45e9-4fd3-b03b-2b507b72686b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1611c46-171f-4d6f-97eb-cfeb5f2cf59e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:18:59 user nova-compute[74701]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:18:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c1b63-6951-404f-a8af-28ce5e3e6de0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== disconnect_volume: return (324ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:18:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:00 user nova-compute[74701]: WARNING nova.compute.manager [req-412186e7-10ef-4ba4-b9b6-f707685ea21e req-a80ed88e-88c0-4977-a7c4-a4c1307187c4 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state resized and task_state resize_reverting.
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'migration_context' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG nova.objects.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Object Instance<e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41> lazy-loaded attributes: resources,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.710s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:01 user nova-compute[74701]: INFO nova.compute.manager [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Swapping old allocation on dict_keys(['40b83711-652c-474c-aa9f-09e010a7f984']) held by migration d4d370b0-ac52-4bc6-9312-f89b39eaca9e for instance
Oct 20 13:19:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Overwriting current allocation {'allocations': {'40b83711-652c-474c-aa9f-09e010a7f984': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '9321569f0e5b4ca49120669fcd48f80b', 'user_id': 'f600c832acd2409c973cfa387a018967', 'consumer_generation': 1} on consumer e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:19:01 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41' (instance-00000011)
Oct 20 13:19:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.421s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.utils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99890064-edca-4937-955b-904d0dfa3fe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfdd73a-cb7d-46f5-b120-e4a917cea992]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1d01f-d557-4f8e-ac1f-6b7d67b90541]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1fc24-c72d-46e7-93cf-a6e3cafa8786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:02 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d3c13-0bfb-4401-97e0-b4da2804999c]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG os_brick.utils [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:05 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:05 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=24.936431884765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c494a9c-1c37-4ade-9d49-da3f29308ead actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 77f5f2e3-32b1-4954-8df3-39598634d419 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 39db995b-5a3b-4077-97fc-81996bb88dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9df84e89-a68c-4d6d-a80f-7ed88f92a50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:19:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:19:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:19:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lazy-loading 'flavor' on Instance uuid 4c494a9c-1c37-4ade-9d49-da3f29308ead {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:20 user nova-compute[74701]: INFO nova.compute.manager [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Attaching volume 1db6a6a0-594f-4ead-82bc-45a8b3d27789 to /dev/vdb
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.utils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc4bc3-f14f-4388-90a9-bf568292a47f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61cb4ae-4bd6-45c3-9f3a-eb5554bd0ebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb14623-d6ce-4a61-86d9-70fffa2b22e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81783c45-c111-42ec-adad-55bc49f3a8f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:20 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:19:20 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098167e-ddcf-406b-93d7-dc5b1ea0a6fe]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG os_brick.utils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:20 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Updating existing volume attachment record: a0ec3196-449d-4f2b-bc7b-b6f4e6e385a9 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Starting finish_revert_migration {{(pid=74701) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start _get_guest_xml network_info=[{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41', 'attached_at': '2023-10-20T13:19:21.000000', 'detached_at': '', 'volume_id': '7152b709-3534-4f9f-a44d-8495533202dc', 'serial': '7152b709-3534-4f9f-a44d-8495533202dc'}, 'attachment_id': '0657a5f3-ff40-4b47-8d11-ccc91e1fe946', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:19:21 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:21 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'vcpu_model' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:21 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:21 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:21 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eded80-ef9f-4d7c-9891-dbfb1ca78004]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:19:21 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c99f5-d045-4416-b8e4-05289afb3146]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc] added
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad4f50-52a0-4398-b9c1-049edd800e3c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76ed2f-1f94-428e-a4b0-b025fcd65207]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdwRCSFt" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134e1a8-2069-4e82-bfa1-9691c159157a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdwRCSFt'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bfeeca-6322-4898-bbeb-cb11d7ef72a3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25d194-185d-4848-97ec-2e58c4a5dd11]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d30b8-f141-4fb8-9b2e-32f4db2755df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:19:21 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-changed-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Refreshing instance network info cache due to event network-changed-5c5fe535-a978-4893-bb16-7e554e8c1346. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] Acquiring lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] Acquired lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG nova.network.neutron [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Refreshing network info cache for port 5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ea451-6215-4d61-ad75-af7ea6578663]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[685cbd9c-8b73-49c0-9ff2-dac419e4cefc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:21 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:21 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6accb976-e593-4f1f-999a-7d29f8165d48]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:19:21 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.neutron [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updated VIF entry in instance network info cache for port 5c5fe535-a978-4893-bb16-7e554e8c1346. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.neutron [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updating instance_info_cache with network_info: [{"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4318e239-bb41-45dd-a70a-25b500ad7f5b req-0e253ca3-ff3d-45d0-93ff-825932630e42 service nova] Releasing lock "refresh_cache-77f5f2e3-32b1-4954-8df3-39598634d419" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383439633437', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:19:22 user nova-compute[74701]:   <uuid>e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</uuid>
Oct 20 13:19:22 user nova-compute[74701]:   <name>instance-00000011</name>
Oct 20 13:19:22 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:19:22 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:19:22 user nova-compute[74701]:   <metadata>
Oct 20 13:19:22 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:19:22 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherB-server-950766450</nova:name>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:19:21</nova:creationTime>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:19:22 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:19:22 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:owner>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:user uuid="f600c832acd2409c973cfa387a018967">tempest-ServerActionsTestOtherB-1560345207-project-member</nova:user>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:project uuid="9321569f0e5b4ca49120669fcd48f80b">tempest-ServerActionsTestOtherB-1560345207</nova:project>
Oct 20 13:19:22 user nova-compute[74701]:       </nova:owner>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:19:22 user nova-compute[74701]:       <nova:ports>
Oct 20 13:19:22 user nova-compute[74701]:         <nova:port uuid="ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4">
Oct 20 13:19:22 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:19:22 user nova-compute[74701]:         </nova:port>
Oct 20 13:19:22 user nova-compute[74701]:       </nova:ports>
Oct 20 13:19:22 user nova-compute[74701]:     </nova:instance>
Oct 20 13:19:22 user nova-compute[74701]:   </metadata>
Oct 20 13:19:22 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:19:22 user nova-compute[74701]:     <system>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="serial">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="uuid">e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41</entry>
Oct 20 13:19:22 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:19:22 user nova-compute[74701]:     </system>
Oct 20 13:19:22 user nova-compute[74701]:   </sysinfo>
Oct 20 13:19:22 user nova-compute[74701]:   <os>
Oct 20 13:19:22 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:19:22 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:19:22 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:19:22 user nova-compute[74701]:   </os>
Oct 20 13:19:22 user nova-compute[74701]:   <features>
Oct 20 13:19:22 user nova-compute[74701]:     <acpi/>
Oct 20 13:19:22 user nova-compute[74701]:     <apic/>
Oct 20 13:19:22 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:19:22 user nova-compute[74701]:   </features>
Oct 20 13:19:22 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:19:22 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:19:22 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:19:22 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:19:22 user nova-compute[74701]:   </clock>
Oct 20 13:19:22 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:19:22 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:19:22 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:19:22 user nova-compute[74701]:   </cpu>
Oct 20 13:19:22 user nova-compute[74701]:   <devices>
Oct 20 13:19:22 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:19:22 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:19:22 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk"/>
Oct 20 13:19:22 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:19:22 user nova-compute[74701]:     </disk>
Oct 20 13:19:22 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:19:22 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:22 user nova-compute[74701]:       <source dev="/dev/sdd"/>
Oct 20 13:19:22 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:19:22 user nova-compute[74701]:       <serial>7152b709-3534-4f9f-a44d-8495533202dc</serial>
Oct 20 13:19:22 user nova-compute[74701]:     </disk>
Oct 20 13:19:22 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:19:22 user nova-compute[74701]:       <mac address="fa:16:3e:db:3b:2b"/>
Oct 20 13:19:22 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:19:22 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:19:22 user nova-compute[74701]:       <target dev="tapffbb1918-8d"/>
Oct 20 13:19:22 user nova-compute[74701]:     </interface>
Oct 20 13:19:22 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:19:22 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/console.log" append="off"/>
Oct 20 13:19:22 user nova-compute[74701]:     </serial>
Oct 20 13:19:22 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:19:22 user nova-compute[74701]:     <video>
Oct 20 13:19:22 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:19:22 user nova-compute[74701]:     </video>
Oct 20 13:19:22 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:19:22 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:19:22 user nova-compute[74701]:     </rng>
Oct 20 13:19:22 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:19:22 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:19:22 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:19:22 user nova-compute[74701]:     </memballoon>
Oct 20 13:19:22 user nova-compute[74701]:   </devices>
Oct 20 13:19:22 user nova-compute[74701]: </domain>
Oct 20 13:19:22 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG os_vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb872d2e-b646-5e04-8321-ad2508627898', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffbb1918-8d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffbb1918-8d, col_values=(('qos', UUID('d9b097c3-5afe-4205-8c6a-dd1887bc4208')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffbb1918-8d, col_values=(('external_ids', {'iface-id': 'ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3b:2b', 'vm-uuid': 'e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:19:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:22 user nova-compute[74701]: INFO os_vif [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:19:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:24 user nova-compute[74701]: WARNING nova.compute.manager [req-edd3ec83-c403-47a5-a83d-8b86a542f153 req-d89290b1-028b-44bb-a3fc-be312e6bee4b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state resized and task_state resize_reverting.
Oct 20 13:19:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:19:25 user nova-compute[74701]: INFO nova.compute.claims [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Claim successful on node user
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:19:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.policy [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df429b97b49043ca8eb2428188581105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c53bd7c9634c1fa382811dd0b74e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:19:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Creating image(s)
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "/opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "/opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "/opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:26 user nova-compute[74701]: WARNING nova.compute.manager [req-34ec0e31-521f-4161-970f-ab9a16cc6c06 req-a72a22c0-113c-4799-b890-f6b312215a9d service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state resized and task_state resize_reverting.
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:19:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance running successfully.
Oct 20 13:19:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] finish_revert_migration finished successfully. {{(pid=74701) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.235s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk 1073741824" returned: 0 in 0.058s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:27 user nova-compute[74701]: INFO nova.compute.manager [None req-d887ddba-5705-4d7e-90f3-13fed942415b tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance to original state: 'active'
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Successfully created port: 40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Cannot resize image /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Ensure instance console log exists: /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Successfully updated port: 40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquired lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-changed-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Refreshing instance network info cache due to event network-changed-40610071-d339-41b5-af36-9b3f0ddee459. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] Acquiring lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating instance_info_cache with network_info: [{"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Releasing lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Instance network_info: |[{"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] Acquired lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Refreshing network info cache for port 40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Start _get_guest_xml network_info=[{"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:19:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-447449680',display_name='tempest-TestServerVolumeAttachmentScenario-server-447449680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-447449680',id=30,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9DrA5PqbtWVc9rdMr/T1+ys6h5vjvqqFO9eK7MEY/Zefy/+7ELll/TimX2eRQqhoiNn4rl+XIi02PKOmLXLHnZSITEx1t01Lt7U+hn5jR7FEyaTKQxxjOT8/V5t20H3w==',key_name='tempest-keypair-542065987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c53bd7c9634c1fa382811dd0b74e69',ramdisk_id='',reservation_id='r-5siiw8j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1216667812',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1216667812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df429b97b49043ca8eb2428188581105',uuid=037ee17d-ff4e-42bb-8c8f-d29d4ed614f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converting VIF {"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'pci_devices' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:19:28 user nova-compute[74701]:   <uuid>037ee17d-ff4e-42bb-8c8f-d29d4ed614f4</uuid>
Oct 20 13:19:28 user nova-compute[74701]:   <name>instance-0000001e</name>
Oct 20 13:19:28 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:19:28 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:19:28 user nova-compute[74701]:   <metadata>
Oct 20 13:19:28 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:19:28 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-447449680</nova:name>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:19:28</nova:creationTime>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:19:28 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:19:28 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:owner>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:user uuid="df429b97b49043ca8eb2428188581105">tempest-TestServerVolumeAttachmentScenario-1216667812-project-member</nova:user>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:project uuid="b4c53bd7c9634c1fa382811dd0b74e69">tempest-TestServerVolumeAttachmentScenario-1216667812</nova:project>
Oct 20 13:19:28 user nova-compute[74701]:       </nova:owner>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:19:28 user nova-compute[74701]:       <nova:ports>
Oct 20 13:19:28 user nova-compute[74701]:         <nova:port uuid="40610071-d339-41b5-af36-9b3f0ddee459">
Oct 20 13:19:28 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 13:19:28 user nova-compute[74701]:         </nova:port>
Oct 20 13:19:28 user nova-compute[74701]:       </nova:ports>
Oct 20 13:19:28 user nova-compute[74701]:     </nova:instance>
Oct 20 13:19:28 user nova-compute[74701]:   </metadata>
Oct 20 13:19:28 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:19:28 user nova-compute[74701]:     <system>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="serial">037ee17d-ff4e-42bb-8c8f-d29d4ed614f4</entry>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="uuid">037ee17d-ff4e-42bb-8c8f-d29d4ed614f4</entry>
Oct 20 13:19:28 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:19:28 user nova-compute[74701]:     </system>
Oct 20 13:19:28 user nova-compute[74701]:   </sysinfo>
Oct 20 13:19:28 user nova-compute[74701]:   <os>
Oct 20 13:19:28 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:19:28 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:19:28 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:19:28 user nova-compute[74701]:   </os>
Oct 20 13:19:28 user nova-compute[74701]:   <features>
Oct 20 13:19:28 user nova-compute[74701]:     <acpi/>
Oct 20 13:19:28 user nova-compute[74701]:     <apic/>
Oct 20 13:19:28 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:19:28 user nova-compute[74701]:   </features>
Oct 20 13:19:28 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:19:28 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:19:28 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:19:28 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:19:28 user nova-compute[74701]:   </clock>
Oct 20 13:19:28 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:19:28 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:19:28 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:19:28 user nova-compute[74701]:   </cpu>
Oct 20 13:19:28 user nova-compute[74701]:   <devices>
Oct 20 13:19:28 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:19:28 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:19:28 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk"/>
Oct 20 13:19:28 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:19:28 user nova-compute[74701]:     </disk>
Oct 20 13:19:28 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:19:28 user nova-compute[74701]:       <mac address="fa:16:3e:f6:19:84"/>
Oct 20 13:19:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:19:28 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:19:28 user nova-compute[74701]:       <target dev="tap40610071-d3"/>
Oct 20 13:19:28 user nova-compute[74701]:     </interface>
Oct 20 13:19:28 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:19:28 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/console.log" append="off"/>
Oct 20 13:19:28 user nova-compute[74701]:     </serial>
Oct 20 13:19:28 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:19:28 user nova-compute[74701]:     <video>
Oct 20 13:19:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:19:28 user nova-compute[74701]:     </video>
Oct 20 13:19:28 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:19:28 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:19:28 user nova-compute[74701]:     </rng>
Oct 20 13:19:28 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:19:28 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:19:28 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:19:28 user nova-compute[74701]:     </memballoon>
Oct 20 13:19:28 user nova-compute[74701]:   </devices>
Oct 20 13:19:28 user nova-compute[74701]: </domain>
Oct 20 13:19:28 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-447449680',display_name='tempest-TestServerVolumeAttachmentScenario-server-447449680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-447449680',id=30,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9DrA5PqbtWVc9rdMr/T1+ys6h5vjvqqFO9eK7MEY/Zefy/+7ELll/TimX2eRQqhoiNn4rl+XIi02PKOmLXLHnZSITEx1t01Lt7U+hn5jR7FEyaTKQxxjOT8/V5t20H3w==',key_name='tempest-keypair-542065987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c53bd7c9634c1fa382811dd0b74e69',ramdisk_id='',reservation_id='r-5siiw8j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1216667812',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1216667812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df429b97b49043ca8eb2428188581105',uuid=037ee17d-ff4e-42bb-8c8f-d29d4ed614f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converting VIF {"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG os_vif [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6506fdab-f74c-5f3f-bedb-b3176a299a29', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40610071-d3, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40610071-d3, col_values=(('qos', UUID('5c18f537-8538-478f-a835-e93428011336')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40610071-d3, col_values=(('external_ids', {'iface-id': '40610071-d339-41b5-af36-9b3f0ddee459', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:19:84', 'vm-uuid': '037ee17d-ff4e-42bb-8c8f-d29d4ed614f4'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:28 user nova-compute[74701]: INFO os_vif [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3')
Oct 20 13:19:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No VIF found with MAC fa:16:3e:f6:19:84, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:29 user nova-compute[74701]: INFO nova.compute.manager [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Attaching volume 00236f48-8c23-4812-a40e-916e8a8d4173 to /dev/vdb
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.utils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d230ecc-c722-47e0-bcdd-6ad205fd3b34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updated VIF entry in instance network info cache for port 40610071-d339-41b5-af36-9b3f0ddee459. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating instance_info_cache with network_info: [{"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78806660-513b-4cd3-8c76-6091ae77fec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a81ca2c4-ef26-4214-a509-b74737e1ef5a req-5d59549d-65c7-40ea-9b8b-794866f40c91 service nova] Releasing lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd408eb0-c71a-4b99-bf3a-7ae4823afad7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30c0e6-530a-49e3-a9b0-3dcf358cd25c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:19:29 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:19:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e170f6d-e3f2-4670-9e80-46b84f6b9cb4]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG os_brick.utils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:29 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updating existing volume attachment record: dc9a8050-559c-42c5-96ea-5f52286e68ca {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] No waiting events found dispatching network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:30 user nova-compute[74701]: WARNING nova.compute.manager [req-de9a368f-f785-492c-9983-0fb6fe6a9ebb req-7cfe9f17-b56d-4dc5-80a9-c28e95ba79b3 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received unexpected event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 for instance with vm_state building and task_state spawning.
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:32 user nova-compute[74701]: INFO nova.compute.manager [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Detaching volume d5369e9a-0724-48d5-b226-ff01b0f2cd8d
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:19:32 user nova-compute[74701]: INFO nova.virt.block_device [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Attempting to driver detach volume d5369e9a-0724-48d5-b226-ff01b0f2cd8d from mountpoint /dev/vdc
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] No waiting events found dispatching network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:32 user nova-compute[74701]: WARNING nova.compute.manager [req-aca885d7-b161-47d9-8e13-b9255a8c9bd1 req-f4873e8a-99ea-4787-8643-128b4b50294a service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received unexpected event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 for instance with vm_state building and task_state spawning.
Oct 20 13:19:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Instance spawned successfully.
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Attempting to detach device vdc from instance 39db995b-5a3b-4077-97fc-81996bb88dd8 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:19:32 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:32 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:19:32 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:19:32 user nova-compute[74701]:   <serial>d5369e9a-0724-48d5-b226-ff01b0f2cd8d</serial>
Oct 20 13:19:32 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:19:32 user nova-compute[74701]: </disk>
Oct 20 13:19:32 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:19:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully detached device vdc from instance 39db995b-5a3b-4077-97fc-81996bb88dd8 from the persistent domain config.
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 39db995b-5a3b-4077-97fc-81996bb88dd8 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:19:32 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:32 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:19:32 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:19:32 user nova-compute[74701]:   <serial>d5369e9a-0724-48d5-b226-ff01b0f2cd8d</serial>
Oct 20 13:19:32 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:19:32 user nova-compute[74701]: </disk>
Oct 20 13:19:32 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:19:32 user nova-compute[74701]: INFO nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Took 6.43 seconds to spawn the instance on the hypervisor.
Oct 20 13:19:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:19:33 user nova-compute[74701]: INFO nova.compute.manager [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Took 7.42 seconds to build instance.
Oct 20 13:19:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d1524d8-60d3-45b8-8345-be878c61c725 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.531s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:19:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtPebdvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:39 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:39 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:39 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:19:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344a4a4-cb1c-4f56-b75a-a8e344c9d728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:19:39 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f753b8-6955-4ed7-a24c-ff5cb2eadddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789] added
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7bc70-503d-457f-b771-d07a16007b40]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e8194-f8bd-4f0d-95be-6cc86c7afe2d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtPebdvo {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtPebdvo" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea092035-5f77-4185-8d7e-b7d2a3f416fd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtPebdvo'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c26235-c9ab-4efd-b953-db1958ccc53f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[07743044-c900-40ec-8942-e9f48396d3d4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b25b4-c768-462c-81f6-36d360ef1ddb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260]
Oct 20 13:19:40 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260] successful.
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f95eb0-845a-4444-a31e-5a4b2ba3d939]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e114db7-8034-435e-a4bb-1d1326b15ddc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:40 user nova-compute[74701]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)
Oct 20 13:19:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63d1476-71f8-421c-b946-4400ab5b20f0]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtPebdvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23165366439303331', 'path': '/dev/sdf'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165366439303331', 'path': '/dev/sdf'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lazy-loading 'flavor' on Instance uuid 4c494a9c-1c37-4ade-9d49-da3f29308ead {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:19:41 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:41 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:19:41 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:19:41 user nova-compute[74701]:   <serial>1db6a6a0-594f-4ead-82bc-45a8b3d27789</serial>
Oct 20 13:19:41 user nova-compute[74701]: </disk>
Oct 20 13:19:41 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] No VIF found with MAC fa:16:3e:83:a3:b7, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:19:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3d907a85-fa90-4a71-a942-8c1df0fc202f tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.293s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:42 user nova-compute[74701]: INFO nova.compute.manager [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Terminating instance
Oct 20 13:19:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-unplugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] No waiting events found dispatching network-vif-unplugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:42 user nova-compute[74701]: DEBUG nova.compute.manager [req-16f23116-091a-444a-9a6d-d0d59996defe req-d557f75d-ce87-4601-840a-330d7ac05929 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-unplugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:19:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Instance destroyed successfully.
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.objects.instance [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lazy-loading 'resources' on Instance uuid 4c494a9c-1c37-4ade-9d49-da3f29308ead {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-609704530',display_name='tempest-DeleteServersTestJSON-server-609704530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-609704530',id=26,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1df9545edc04414abcd71cd706bd7b99',ramdisk_id='',reservation_id='r-193kb0l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1901288561',owner_user_name='tempest-DeleteServersTestJSON-1901288561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:17:32Z,user_data=None,user_id='7973d8d54c1547f5bf177716846a0c1e',uuid=4c494a9c-1c37-4ade-9d49-da3f29308ead,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converting VIF {"id": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "address": "fa:16:3e:83:a3:b7", "network": {"id": "d1f26fac-646c-44fb-a27e-b07c67763691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1027446299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df9545edc04414abcd71cd706bd7b99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee5d8c-72", "ovs_interfaceid": "b7ee5d8c-7282-40a3-9ce2-eff710b79154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_vif [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ee5d8c-72, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2eecc304-8c00-4e95-9fb0-7861438e4b87) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:43 user nova-compute[74701]: INFO os_vif [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=b7ee5d8c-7282-40a3-9ce2-eff710b79154,network=Network(d1f26fac-646c-44fb-a27e-b07c67763691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee5d8c-72')
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtPebdvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:43 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb11d2-6444-4777-ab06-cd443aa06e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:19:43 user nova-compute[74701]: No targets found.
Oct 20 13:19:43 user nova-compute[74701]: iSNS:
Oct 20 13:19:43 user nova-compute[74701]: No targets found.
Oct 20 13:19:43 user nova-compute[74701]: STATIC:
Oct 20 13:19:43 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:19:43 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:43 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:43 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789
Oct 20 13:19:43 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:43 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:43 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d
Oct 20 13:19:43 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:43 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:43 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:19:43 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:43 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:43 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:19:43 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:43 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:43 user nova-compute[74701]: FIRMWARE:
Oct 20 13:19:43 user nova-compute[74701]: No targets found.
Oct 20 13:19:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:19:43 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:19:43 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16021714-e31a-4e46-8692-2941f2aa9bdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec3f3d-b028-4c90-97b3-85b89050ee72]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)
Oct 20 13:19:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:43 user nova-compute[74701]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 (non-flash)
Oct 20 13:19:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02636d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789'): ({'sdf'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Removing single pathed devices sdf {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9801edfc-b712-4207-9fbf-805ce20a35ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe265ae-5e2c-41fe-8d40-a4e5f3fead39]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Flushing IO for device /dev/sdf {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7b297c-128f-421b-83d8-fd8a15c99f98]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[11799745-8764-4e17-946c-47657e0da6ca]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e6e46-aade-420f-8be0-7b141fa90bff]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408a33b-776b-4638-9576-24d578a3e73d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260]
Oct 20 13:19:43 user nova-compute[74701]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789, portal: 172.16.0.220,3260] successful.
Oct 20 13:19:43 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db6a6a0-594f-4ead-82bc-45a8b3d27789 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf6ebe4-018f-4566-a140-8ae8ef59506f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] <== disconnect_volume: return (324ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:19:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Deleting instance files /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead_del
Oct 20 13:19:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Deletion of /opt/stack/data/nova/instances/4c494a9c-1c37-4ade-9d49-da3f29308ead_del complete
Oct 20 13:19:44 user nova-compute[74701]: INFO nova.compute.manager [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Took 1.50 seconds to destroy the instance on the hypervisor.
Oct 20 13:19:44 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:19:44 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:19:44 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:19:44 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:19:44 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Took 0.45 seconds to deallocate network for instance.
Oct 20 13:19:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] Acquiring lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] No waiting events found dispatching network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:19:45 user nova-compute[74701]: WARNING nova.compute.manager [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received unexpected event network-vif-plugged-b7ee5d8c-7282-40a3-9ce2-eff710b79154 for instance with vm_state active and task_state deleting.
Oct 20 13:19:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec93cbcb-139c-4898-bbeb-0b29f94c9d44 req-78040c4a-8d46-4be8-a48e-6836251618b9 service nova] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Received event network-vif-deleted-b7ee5d8c-7282-40a3-9ce2-eff710b79154 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:19:45 user nova-compute[74701]: INFO nova.compute.manager [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] [instance: 4c494a9c-1c37-4ade-9d49-da3f29308ead] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:45 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Deleted allocations for instance 4c494a9c-1c37-4ade-9d49-da3f29308ead
Oct 20 13:19:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45fc807e-a5ba-458b-844e-9269e390b916 tempest-DeleteServersTestJSON-1901288561 tempest-DeleteServersTestJSON-1901288561-project-member] Lock "4c494a9c-1c37-4ade-9d49-da3f29308ead" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.345s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpzLMZgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:48 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[04403702-bd47-4b50-a5c4-2381a3d6e7bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:19:48 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d519c1-6fc3-42f1-9119-c2dedc64add7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173] added
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3946f9b-f140-495a-bad7-29de7fceba46]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d0cdc3-6f19-4262-9ec5-9456e9e16627]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpzLMZgI {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpzLMZgI" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd08ecc-1715-48e5-b1b8-07acc241fce1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SpzLMZgI'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10241f-b4a7-4fa8-9a3e-830f3f73deab]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cd1728-64af-466f-b57e-5984765b3337]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e078cee8-54bf-476a-9d37-6ae8fec7f5a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260]
Oct 20 13:19:48 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260] successful.
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b4cbda-a066-43d8-b1e0-31577fedbe83]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bde210-b748-4862-bf4d-53cf0e9986d6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:48 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:19:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc3b03-80bc-446b-9e2e-bc6ae7a1dad0]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:19:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpzLMZgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:19:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23632356438333466', 'path': '/dev/sdf'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632356438333466', 'path': '/dev/sdf'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:19:49 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:19:49 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:49 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:19:49 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:19:49 user nova-compute[74701]:   <serial>00236f48-8c23-4812-a40e-916e8a8d4173</serial>
Oct 20 13:19:49 user nova-compute[74701]: </disk>
Oct 20 13:19:49 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] No VIF found with MAC fa:16:3e:b7:b2:73, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7723c0fd-2d29-4d0b-a570-6ffb56ead580 tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.151s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:50 user nova-compute[74701]: INFO nova.compute.manager [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Detaching volume 00236f48-8c23-4812-a40e-916e8a8d4173
Oct 20 13:19:50 user nova-compute[74701]: INFO nova.virt.block_device [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Attempting to driver detach volume 00236f48-8c23-4812-a40e-916e8a8d4173 from mountpoint /dev/vdb
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Attempting to detach device vdb from instance 77f5f2e3-32b1-4954-8df3-39598634d419 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:19:50 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:50 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:19:50 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:19:50 user nova-compute[74701]:   <serial>00236f48-8c23-4812-a40e-916e8a8d4173</serial>
Oct 20 13:19:50 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:19:50 user nova-compute[74701]: </disk>
Oct 20 13:19:50 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:19:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance 77f5f2e3-32b1-4954-8df3-39598634d419 from the persistent domain config.
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77f5f2e3-32b1-4954-8df3-39598634d419 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:19:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:19:50 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:19:50 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:19:50 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:19:50 user nova-compute[74701]:   <serial>00236f48-8c23-4812-a40e-916e8a8d4173</serial>
Oct 20 13:19:50 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:19:50 user nova-compute[74701]: </disk>
Oct 20 13:19:50 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:19:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:19:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 39db995b-5a3b-4077-97fc-81996bb88dd8 is timed out.
Oct 20 13:19:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully detached device vdc from instance 39db995b-5a3b-4077-97fc-81996bb88dd8 from the live domain config.
Oct 20 13:19:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbOBgTkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:19:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d2ec54-3ac8-49dc-9943-799d52aac127]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:19:53 user nova-compute[74701]: No targets found.
Oct 20 13:19:53 user nova-compute[74701]: iSNS:
Oct 20 13:19:53 user nova-compute[74701]: No targets found.
Oct 20 13:19:53 user nova-compute[74701]: STATIC:
Oct 20 13:19:53 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:19:53 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:53 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:53 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173
Oct 20 13:19:53 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:53 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:53 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d
Oct 20 13:19:53 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:53 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:53 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:19:53 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:53 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:53 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:19:53 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:19:53 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:19:53 user nova-compute[74701]: FIRMWARE:
Oct 20 13:19:53 user nova-compute[74701]: No targets found.
Oct 20 13:19:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:19:53 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:19:53 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ea82a-5ca6-4529-a89b-9efc5999cee2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f493905-061b-451f-a292-1a1eeba32fbe]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:19:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:19:53 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:19:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc622c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d'): ({'sde'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Removing single pathed devices sde {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4716a-a690-4d67-a70b-6dd0ca1e6590]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe2b9ec-8f29-4d63-a85c-7800fef2c6bc]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flushing IO for device /dev/sde {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[269a70a1-eb5c-4b43-b255-d2e41fc0001d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[89618c90-77d8-4857-bb4b-10018a655f4b]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee6f14-9a8d-446c-b2c4-d00dc173cc77]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[48915e20-01ec-439a-96d1-b71f598ec961]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260]
Oct 20 13:19:53 user nova-compute[74701]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d, portal: 172.16.0.220,3260] successful.
Oct 20 13:19:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5369e9a-0724-48d5-b226-ff01b0f2cd8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809fef6-eced-49ed-8e4c-3370dcb40678]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] <== disconnect_volume: return (316ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:19:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:19:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'flavor' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:19:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-360fc895-81f9-4e78-bdb7-2cf228928984 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.743s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:19:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:19:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-changed-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Refreshing instance network info cache due to event network-changed-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] Acquiring lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] Acquired lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Refreshing network info cache for port 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.objects.instance [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'flavor' on Instance uuid 372102fa-399b-4ae2-8c73-23b250e4d790 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updated VIF entry in instance network info cache for port 383ceab8-ce75-4ada-8fff-ea65fbe8e7ca. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updating instance_info_cache with network_info: [{"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0f6afe0-b502-4ebd-99b0-76f68a4c5a6e req-a6b7e9dc-fb7e-4c29-abad-77c8c3e2edc5 service nova] Releasing lock "refresh_cache-372102fa-399b-4ae2-8c73-23b250e4d790" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:01 user nova-compute[74701]: INFO nova.compute.manager [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Attaching volume 348756f0-46f1-4810-aeb1-53336cc1d695 to /dev/vdb
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG os_brick.utils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fb94b-2883-4f7f-88c1-568c300e86c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68cae31-5cd7-4af8-89f2-385d24126e4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ade0b-c76f-490a-8c95-ec0174b1379a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d43904-d5ca-4a2f-b565-86e877d5a054]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:20:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:20:02 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d05743-2fb1-4d8d-ad3b-5b211fb229b6]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG os_brick.utils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updating existing volume attachment record: ea6503a2-e169-492b-992b-66960250a169 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:20:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7110MB free_disk=24.94986343383789GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 77f5f2e3-32b1-4954-8df3-39598634d419 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 39db995b-5a3b-4077-97fc-81996bb88dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9df84e89-a68c-4d6d-a80f-7ed88f92a50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:20:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [{"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:20:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:20:08 user nova-compute[74701]: INFO nova.compute.claims [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Claim successful on node user
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:20:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.policy [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '751a8755f9774b1da2e71623164c40b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed52bceb45147ceb782e49acf3a9d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:20:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Creating image(s)
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "/opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk 1073741824" returned: 0 in 0.265s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.440s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Successfully created port: 53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Cannot resize image /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Ensure instance console log exists: /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Successfully updated port: 53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-changed-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Refreshing instance network info cache due to event network-changed-53350cf6-0dbf-4a16-b794-601d3ca4d2b2. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] Acquiring lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updating instance_info_cache with network_info: [{"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Instance network_info: |[{"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] Acquired lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Refreshing network info cache for port 53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Start _get_guest_xml network_info=[{"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:20:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:20:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281289606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281289606',id=31,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-0tg90v5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:20:09Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=611fd7ef-e138-4a36-b1ab-5d948038429a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 611fd7ef-e138-4a36-b1ab-5d948038429a {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:20:11 user nova-compute[74701]:   <uuid>611fd7ef-e138-4a36-b1ab-5d948038429a</uuid>
Oct 20 13:20:11 user nova-compute[74701]:   <name>instance-0000001f</name>
Oct 20 13:20:11 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:20:11 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:20:11 user nova-compute[74701]:   <metadata>
Oct 20 13:20:11 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:20:11 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1281289606</nova:name>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:20:11</nova:creationTime>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:20:11 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:20:11 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:owner>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:20:11 user nova-compute[74701]:       </nova:owner>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:20:11 user nova-compute[74701]:       <nova:ports>
Oct 20 13:20:11 user nova-compute[74701]:         <nova:port uuid="53350cf6-0dbf-4a16-b794-601d3ca4d2b2">
Oct 20 13:20:11 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:20:11 user nova-compute[74701]:         </nova:port>
Oct 20 13:20:11 user nova-compute[74701]:       </nova:ports>
Oct 20 13:20:11 user nova-compute[74701]:     </nova:instance>
Oct 20 13:20:11 user nova-compute[74701]:   </metadata>
Oct 20 13:20:11 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:20:11 user nova-compute[74701]:     <system>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="serial">611fd7ef-e138-4a36-b1ab-5d948038429a</entry>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="uuid">611fd7ef-e138-4a36-b1ab-5d948038429a</entry>
Oct 20 13:20:11 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:20:11 user nova-compute[74701]:     </system>
Oct 20 13:20:11 user nova-compute[74701]:   </sysinfo>
Oct 20 13:20:11 user nova-compute[74701]:   <os>
Oct 20 13:20:11 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:20:11 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:20:11 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:20:11 user nova-compute[74701]:   </os>
Oct 20 13:20:11 user nova-compute[74701]:   <features>
Oct 20 13:20:11 user nova-compute[74701]:     <acpi/>
Oct 20 13:20:11 user nova-compute[74701]:     <apic/>
Oct 20 13:20:11 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:20:11 user nova-compute[74701]:   </features>
Oct 20 13:20:11 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:20:11 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:20:11 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:20:11 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:20:11 user nova-compute[74701]:   </clock>
Oct 20 13:20:11 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:20:11 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:20:11 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:20:11 user nova-compute[74701]:   </cpu>
Oct 20 13:20:11 user nova-compute[74701]:   <devices>
Oct 20 13:20:11 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:20:11 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:20:11 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk"/>
Oct 20 13:20:11 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:20:11 user nova-compute[74701]:     </disk>
Oct 20 13:20:11 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:20:11 user nova-compute[74701]:       <mac address="fa:16:3e:ea:a0:96"/>
Oct 20 13:20:11 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:20:11 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:20:11 user nova-compute[74701]:       <target dev="tap53350cf6-0d"/>
Oct 20 13:20:11 user nova-compute[74701]:     </interface>
Oct 20 13:20:11 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:20:11 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/console.log" append="off"/>
Oct 20 13:20:11 user nova-compute[74701]:     </serial>
Oct 20 13:20:11 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:20:11 user nova-compute[74701]:     <video>
Oct 20 13:20:11 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:20:11 user nova-compute[74701]:     </video>
Oct 20 13:20:11 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:20:11 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:20:11 user nova-compute[74701]:     </rng>
Oct 20 13:20:11 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:20:11 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:20:11 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:20:11 user nova-compute[74701]:     </memballoon>
Oct 20 13:20:11 user nova-compute[74701]:   </devices>
Oct 20 13:20:11 user nova-compute[74701]: </domain>
Oct 20 13:20:11 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281289606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281289606',id=31,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-0tg90v5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:20:09Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=611fd7ef-e138-4a36-b1ab-5d948038429a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_vif [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b94875a-de46-5d6c-b8f7-bd1e69960aef', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53350cf6-0d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53350cf6-0d, col_values=(('qos', UUID('78ba3d85-7353-47d4-a088-9c0ed719efea')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53350cf6-0d, col_values=(('external_ids', {'iface-id': '53350cf6-0dbf-4a16-b794-601d3ca4d2b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a0:96', 'vm-uuid': '611fd7ef-e138-4a36-b1ab-5d948038429a'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:11 user nova-compute[74701]: INFO os_vif [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d')
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:ea:a0:96, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:20:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77f5f2e3-32b1-4954-8df3-39598634d419 is timed out.
Oct 20 13:20:11 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully detached device vdb from instance 77f5f2e3-32b1-4954-8df3-39598634d419 from the live domain config.
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpzLMZgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:20:11 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ea2e2-a49c-4100-b71d-6f7e3edabed4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:20:11 user nova-compute[74701]: No targets found.
Oct 20 13:20:11 user nova-compute[74701]: iSNS:
Oct 20 13:20:11 user nova-compute[74701]: No targets found.
Oct 20 13:20:11 user nova-compute[74701]: STATIC:
Oct 20 13:20:11 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:20:11 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:20:11 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:20:11 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173
Oct 20 13:20:11 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:20:11 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:20:11 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:20:11 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:20:11 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:20:11 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:20:11 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:20:11 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:20:11 user nova-compute[74701]: FIRMWARE:
Oct 20 13:20:11 user nova-compute[74701]: No targets found.
Oct 20 13:20:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:20:11 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:20:11 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb98088c-8b77-45e4-9cc4-b6e33a7177ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42b28a-e3d1-4177-937f-f1cfb986ebdd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:20:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:20:11 user nova-compute[74701]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 (non-flash)
Oct 20 13:20:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86f8251870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173'): ({'sdf'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Removing single pathed devices sdf {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3e43f-d16c-4067-a9cf-6e240123bcbb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9808f-d899-4d29-a64a-1fb3d92d0e98]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Flushing IO for device /dev/sdf {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c45259-5cdd-4749-a779-444bb6d45d11]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updated VIF entry in instance network info cache for port 53350cf6-0dbf-4a16-b794-601d3ca4d2b2. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updating instance_info_cache with network_info: [{"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f47989-d958-4f0f-891d-bc4e4ae730e1]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0ee0e34b-87f7-4aef-a450-6b8cb19ab735 req-6d6567e8-6116-483f-9275-b88f95cc1daa service nova] Releasing lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f742cf-5451-4747-8d19-3cc014a01d51]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0bcb1d-6cd0-493e-bf4e-52288bc2f382]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260]
Oct 20 13:20:11 user nova-compute[74701]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173, portal: 172.16.0.220,3260] successful.
Oct 20 13:20:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00236f48-8c23-4812-a40e-916e8a8d4173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16e4fd-4dbf-49ff-9b57-11c5228e54c3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] <== disconnect_volume: return (304ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:20:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'flavor' on Instance uuid 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8130fa13-b8e5-4f87-a152-94b954f2520d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.volume.cinder [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Update attachment failed for attachment ea6503a2-e169-492b-992b-66960250a169. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23)
Oct 20 13:20:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Failed to attach 348756f0-46f1-4810-aeb1-53336cc1d695 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Traceback (most recent call last):
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     self._do_attach(context, instance, volume, volume_api,
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     self._volume_attach(context, volume, connector, instance,
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     connection_info = volume_api.attachment_update(
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     res = method(self, ctx, *args, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     with excutils.save_and_reraise_exception():
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     self.force_reraise()
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     raise self.value
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     return method.func(obj, *args, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     resp = self._update('/attachments/%s' % id, body)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     return self.request(url, method, **kwargs)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790]     raise exceptions.from_response(resp, body)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23)
Oct 20 13:20:12 user nova-compute[74701]: ERROR nova.compute.manager [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] 
Oct 20 13:20:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] No waiting events found dispatching network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:12 user nova-compute[74701]: WARNING nova.compute.manager [req-bba13b4c-aa4b-4ae7-b862-995f5a5c2971 req-8d93402a-a334-47af-8584-528ec9a78922 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received unexpected event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 for instance with vm_state building and task_state spawning.
Oct 20 13:20:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.208s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server [None req-98f20c4c-e4d3-442d-ac30-6f0f2a722417 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f072591f-121c-46f1-bf77-757475293f23)
Oct 20 13:20:13 user nova-compute[74701]: ERROR oslo_messaging.rpc.server 
Oct 20 13:20:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:20:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Instance spawned successfully.
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] No waiting events found dispatching network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:14 user nova-compute[74701]: WARNING nova.compute.manager [req-649a0432-5c23-40ea-a39f-5fcb9f482efa req-5850b961-f5ba-4b49-853f-f6e12a67b198 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received unexpected event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 for instance with vm_state building and task_state spawning.
Oct 20 13:20:14 user nova-compute[74701]: INFO nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 20 13:20:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:20:15 user nova-compute[74701]: INFO nova.compute.manager [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Took 6.20 seconds to build instance.
Oct 20 13:20:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a55abc8f-a854-4de8-8a0a-1be2f49a6e1c tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.299s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:23 user nova-compute[74701]: INFO nova.compute.manager [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Terminating instance
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-3cc578d6-7a85-4aba-aebd-795de6087692 req-9d515f8b-3962-4be6-8f35-63f68939d920 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-unplugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:20:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Instance destroyed successfully.
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.objects.instance [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'resources' on Instance uuid 39db995b-5a3b-4077-97fc-81996bb88dd8 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1514932320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1514932320',id=19,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/KEWGZFGCLdFwPKV1pah4nx6zxk2pfe5LGo37B+gmjIBM0NERgCoGz1dUbwQukcpOrm0jVNFGkc1pxWH6BlZNotFKl8swMLaq8bkOXQbIUvmpXI5M6ow4RZFwsMWz4mg==',key_name='tempest-keypair-704380112',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-kcjwei30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=39db995b-5a3b-4077-97fc-81996bb88dd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "address": "fa:16:3e:17:a3:23", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap119c01dd-e2", "ovs_interfaceid": "119c01dd-e22d-4d3d-a529-b1a16a01f9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG os_vif [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap119c01dd-e2, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=266ed708-7f93-4886-9122-ce04c16edc45) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:23 user nova-compute[74701]: INFO os_vif [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a3:23,bridge_name='br-int',has_traffic_filtering=True,id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap119c01dd-e2')
Oct 20 13:20:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Deleting instance files /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8_del
Oct 20 13:20:23 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Deletion of /opt/stack/data/nova/instances/39db995b-5a3b-4077-97fc-81996bb88dd8_del complete
Oct 20 13:20:23 user nova-compute[74701]: INFO nova.compute.manager [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 13:20:23 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:20:23 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:24 user nova-compute[74701]: INFO nova.compute.manager [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Terminating instance
Oct 20 13:20:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Instance destroyed successfully.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.objects.instance [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lazy-loading 'resources' on Instance uuid 9df84e89-a68c-4d6d-a80f-7ed88f92a50d {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2013073953',display_name='tempest-VolumesActionsTest-instance-2013073953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2013073953',id=29,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:18:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b73abb7994b4ce1b83d9d35b4a5e272',ramdisk_id='',reservation_id='r-zd9z28y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1955537551',owner_user_name='tempest-VolumesActionsTest-1955537551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:40Z,user_data=None,user_id='5447da7d31cf44ba84c5836599970f3d',uuid=9df84e89-a68c-4d6d-a80f-7ed88f92a50d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converting VIF {"id": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "address": "fa:16:3e:fe:4c:f6", "network": {"id": "c35ccf30-aeb9-450e-a1f0-8a6a986da6b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474818731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b73abb7994b4ce1b83d9d35b4a5e272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9220de-83", "ovs_interfaceid": "7a9220de-83c2-4c6c-b0c1-115dc3a41a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG os_vif [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9220de-83, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=704a4bee-212f-4025-bff9-1916866e715a) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:25 user nova-compute[74701]: INFO os_vif [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4c:f6,bridge_name='br-int',has_traffic_filtering=True,id=7a9220de-83c2-4c6c-b0c1-115dc3a41a79,network=Network(c35ccf30-aeb9-450e-a1f0-8a6a986da6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9220de-83')
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Deleting instance files /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d_del
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Deletion of /opt/stack/data/nova/instances/9df84e89-a68c-4d6d-a80f-7ed88f92a50d_del complete
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.compute.manager [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Acquiring lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] No waiting events found dispatching network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:25 user nova-compute[74701]: WARNING nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received unexpected event network-vif-plugged-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 for instance with vm_state active and task_state deleting.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-unplugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] No waiting events found dispatching network-vif-unplugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-unplugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Acquiring lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] No waiting events found dispatching network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:25 user nova-compute[74701]: WARNING nova.compute.manager [req-7f5f8f6d-fa55-475a-9247-e20f11134e79 req-31b1c5ec-95cc-49ef-b9d3-0b9d47c90bb7 service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received unexpected event network-vif-plugged-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 for instance with vm_state active and task_state deleting.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Took 1.57 seconds to deallocate network for instance.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-9dc36732-6008-43e9-96de-c33b794c10cf req-bff0c12c-a05b-43df-a264-05794cdaf8af service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Received event network-vif-deleted-119c01dd-e22d-4d3d-a529-b1a16a01f9a8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.compute.manager [req-9dc36732-6008-43e9-96de-c33b794c10cf req-bff0c12c-a05b-43df-a264-05794cdaf8af service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Neutron deleted interface 119c01dd-e22d-4d3d-a529-b1a16a01f9a8; detaching it from the instance and deleting it from the info cache
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-9dc36732-6008-43e9-96de-c33b794c10cf req-bff0c12c-a05b-43df-a264-05794cdaf8af service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-9dc36732-6008-43e9-96de-c33b794c10cf req-bff0c12c-a05b-43df-a264-05794cdaf8af service nova] [instance: 39db995b-5a3b-4077-97fc-81996bb88dd8] Detach interface failed, port_id=119c01dd-e22d-4d3d-a529-b1a16a01f9a8, reason: Instance 39db995b-5a3b-4077-97fc-81996bb88dd8 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:25 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Took 0.52 seconds to deallocate network for instance.
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-e5af2716-896f-4025-88d1-d2c749ab3ec9 req-7d89ab9a-9125-4312-b44c-f88ed999271d service nova] [instance: 9df84e89-a68c-4d6d-a80f-7ed88f92a50d] Received event network-vif-deleted-7a9220de-83c2-4c6c-b0c1-115dc3a41a79 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.134s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:26 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Deleted allocations for instance 39db995b-5a3b-4077-97fc-81996bb88dd8
Oct 20 13:20:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-353545bf-f40f-47d8-bd2c-bb57c4ec26b6 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "39db995b-5a3b-4077-97fc-81996bb88dd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.210s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:20:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:26 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Deleted allocations for instance 9df84e89-a68c-4d6d-a80f-7ed88f92a50d
Oct 20 13:20:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-99a570ca-c7a1-408e-8d29-b6411ada1ee4 tempest-VolumesActionsTest-1955537551 tempest-VolumesActionsTest-1955537551-project-member] Lock "9df84e89-a68c-4d6d-a80f-7ed88f92a50d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing instance network info cache due to event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updated VIF entry in instance network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ba940dd-b8b3-4143-89b6-3de163b79be5 req-34921d42-f106-43a9-8310-e2bac7cf38dc service nova] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:39 user nova-compute[74701]: INFO nova.compute.manager [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Detaching volume f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:20:39 user nova-compute[74701]: INFO nova.virt.block_device [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Attempting to driver detach volume f8d97739-6436-4ee3-94e6-69d6b46c76cf from mountpoint /dev/vdb
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Attempting to detach device vdb from instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:20:39 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:20:39 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:20:39 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:20:39 user nova-compute[74701]:   <serial>f8d97739-6436-4ee3-94e6-69d6b46c76cf</serial>
Oct 20 13:20:39 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:20:39 user nova-compute[74701]: </disk>
Oct 20 13:20:39 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:20:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully detached device vdb from instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f from the persistent domain config.
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:20:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:20:39 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:20:39 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:20:39 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:20:39 user nova-compute[74701]:   <serial>f8d97739-6436-4ee3-94e6-69d6b46c76cf</serial>
Oct 20 13:20:39 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:20:39 user nova-compute[74701]: </disk>
Oct 20 13:20:39 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:20:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:20:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:41 user nova-compute[74701]: INFO nova.compute.manager [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Terminating instance
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing instance network info cache due to event network-changed-0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] Acquiring lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] Acquired lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Refreshing network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Instance destroyed successfully.
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lazy-loading 'resources' on Instance uuid 77f5f2e3-32b1-4954-8df3-39598634d419 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1473573888',display_name='tempest-AttachVolumeNegativeTest-server-1473573888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1473573888',id=27,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD0gLWmBVnjuDkm/E6RaUjgC83r4k+RTASyBSKIPsURlvxJCZmWzmrM1wGoX0Sdst0GTwgyI9QLW592qYnNBjY/0+2z40EzM+06mZV0mldo7Qr9ECrv6E0Jcvojb/0Zig==',key_name='tempest-keypair-550546839',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea6d60f8e654cc2af2ec7085c001ea1',ramdisk_id='',reservation_id='r-u93pgwdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1431718944',owner_user_name='tempest-AttachVolumeNegativeTest-1431718944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09e73f4fb1c410db0d365d04722a4fe',uuid=77f5f2e3-32b1-4954-8df3-39598634d419,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converting VIF {"id": "5c5fe535-a978-4893-bb16-7e554e8c1346", "address": "fa:16:3e:b7:b2:73", "network": {"id": "47e580ce-a11c-43e2-880d-c4c45dd37f5c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1354785477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea6d60f8e654cc2af2ec7085c001ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5fe535-a9", "ovs_interfaceid": "5c5fe535-a978-4893-bb16-7e554e8c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG os_vif [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c5fe535-a9, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a217ddcd-dc6a-4aaf-986d-644d21ba9b37) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:42 user nova-compute[74701]: INFO os_vif [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:73,bridge_name='br-int',has_traffic_filtering=True,id=5c5fe535-a978-4893-bb16-7e554e8c1346,network=Network(47e580ce-a11c-43e2-880d-c4c45dd37f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5fe535-a9')
Oct 20 13:20:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Deleting instance files /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419_del
Oct 20 13:20:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Deletion of /opt/stack/data/nova/instances/77f5f2e3-32b1-4954-8df3-39598634d419_del complete
Oct 20 13:20:42 user nova-compute[74701]: DEBUG nova.network.neutron [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updated VIF entry in instance network info cache for port 0bf1252a-3258-4278-80d1-bff6c2aad9cb. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG nova.network.neutron [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [{"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f0194b57-2f02-4b5f-9ea0-4273fcc05f6d req-f6227662-0292-4d2d-8058-61fd46533645 service nova] Releasing lock "refresh_cache-d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:20:42 user nova-compute[74701]: INFO nova.compute.manager [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 13:20:42 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:43 user nova-compute[74701]: WARNING nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state active and task_state deleting.
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:43 user nova-compute[74701]: WARNING nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state active and task_state deleting.
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:43 user nova-compute[74701]: WARNING nova.compute.manager [req-eb541f35-0ffb-458a-8aab-6c281a509f10 req-1a52f697-15e3-4ae1-9ad8-816659e0507b service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state active and task_state deleting.
Oct 20 13:20:43 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:20:43 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Took 1.55 seconds to deallocate network for instance.
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:44 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:20:44 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:20:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:44 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Deleted allocations for instance 77f5f2e3-32b1-4954-8df3-39598634d419
Oct 20 13:20:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b19f8112-d834-4554-85ee-4b7bbbaf129d tempest-AttachVolumeNegativeTest-1431718944 tempest-AttachVolumeNegativeTest-1431718944-project-member] Lock "77f5f2e3-32b1-4954-8df3-39598634d419" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:45 user nova-compute[74701]: WARNING nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-unplugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state deleted and task_state None.
Oct 20 13:20:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Acquiring lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] Lock "77f5f2e3-32b1-4954-8df3-39598634d419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] No waiting events found dispatching network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:20:45 user nova-compute[74701]: WARNING nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received unexpected event network-vif-plugged-5c5fe535-a978-4893-bb16-7e554e8c1346 for instance with vm_state deleted and task_state None.
Oct 20 13:20:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-406c4628-b75d-4d4b-8e36-f97324076942 req-945e626a-3b05-4a01-8ece-ba213da4c73c service nova] [instance: 77f5f2e3-32b1-4954-8df3-39598634d419] Received event network-vif-deleted-5c5fe535-a978-4893-bb16-7e554e8c1346 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:20:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:20:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:20:59 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:20:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:20:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:20:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:20:59 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f is timed out.
Oct 20 13:21:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully detached device vdb from instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f from the live domain config.
Oct 20 13:21:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAkXEpje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:21:00 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22937d6d-ac0e-4b57-a7bc-9262c884f964]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:21:00 user nova-compute[74701]: No targets found.
Oct 20 13:21:00 user nova-compute[74701]: iSNS:
Oct 20 13:21:00 user nova-compute[74701]: No targets found.
Oct 20 13:21:00 user nova-compute[74701]: STATIC:
Oct 20 13:21:00 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:21:00 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:00 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:00 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf
Oct 20 13:21:00 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:00 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:00 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:21:00 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:00 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:00 user nova-compute[74701]: FIRMWARE:
Oct 20 13:21:00 user nova-compute[74701]: No targets found.
Oct 20 13:21:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:21:00 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:21:00 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3bda7c-3c08-4b45-85ef-ddcc3e7e51a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613c115-5a0f-4fb0-be8a-136a55b0bdbc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:00 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:21:00 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:00 user nova-compute[74701]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf (non-flash)
Oct 20 13:21:00 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8701288a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2861532-2b6b-4a89-9a40-1d4fab6c4c67]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42feef68-8fe2-44ef-b448-beddfab37f0b]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9f8d4a-989e-4d3c-8dd1-843b5bc96cec]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[36612736-c5eb-4dc8-a67f-be5bc154b54b]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3332e5a2-2779-4779-bccc-bdeecac6d808]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e05308-1d48-425b-a109-1d0a91fc2c90]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260]
Oct 20 13:21:00 user nova-compute[74701]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf, portal: 172.16.0.220,3260] successful.
Oct 20 13:21:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d97739-6436-4ee3-94e6-69d6b46c76cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2f5c06-394b-4474-a655-90822c659f54]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] <== disconnect_volume: return (356ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG nova.objects.instance [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'flavor' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-68a34118-1b77-4d89-a785-426a4c690374 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:21:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=24.993717193603516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:21:04 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:21:05 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:21:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:21:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [{"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:21:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-changed-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Refreshing instance network info cache due to event network-changed-40610071-d339-41b5-af36-9b3f0ddee459. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] Acquiring lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] Acquired lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Refreshing network info cache for port 40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updated VIF entry in instance network info cache for port 40610071-d339-41b5-af36-9b3f0ddee459. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:21:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating instance_info_cache with network_info: [{"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-50614e3b-268a-4be6-9c4a-3b39bb64f887 req-f8cc7583-d303-4b09-9c1e-695c572f49cf service nova] Releasing lock "refresh_cache-037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:17 user nova-compute[74701]: INFO nova.compute.manager [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attaching volume 4c17f494-283b-45b5-9c39-3b236a8e4134 to /dev/vdb
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:21:17 user nova-compute[74701]: INFO nova.compute.claims [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Claim successful on node user
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.utils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a997c-986c-4602-a770-1735cf710805]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55d4173-f72c-4705-ad33-a250dbb5b183]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1a814-2c0a-43a6-9297-73a9ac4ca7df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a0ee4-6ede-40cb-a4c1-ca2195b1acd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:21:17 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:21:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3763cb5d-5496-453d-8a7a-fcc2b5bfe2ce]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG os_brick.utils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:21:17 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating existing volume attachment record: 456f211b-1136-43e6-83e6-a1275fc50a78 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:21:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.policy [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22371d97e6c1416499916660b5b2b07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf15939da12479f9c7bfff1c4198efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:21:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Creating image(s)
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.241s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk 1073741824" returned: 0 in 0.056s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Successfully created port: 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Cannot resize image /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Ensure instance console log exists: /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Successfully updated port: 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing instance network info cache due to event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:21:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance network_info: |[{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start _get_guest_xml network_info=[{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:21:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:21:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOyiLPG43sf8nTt6IdNQyV81L+L8gnxG8o7EsoHItaOu4r39dqcrkLJviW7zglttU3kDgBbImUjSllgkkT2IT1V2vOgacq/jGB69IMuUKNL2UNlpPrglBw/MA7ykxyY2Q==',key_name='tempest-keypair-194972029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:21:20 user nova-compute[74701]:   <uuid>8fc7fb59-af87-4358-a67f-1f2d6abb9a56</uuid>
Oct 20 13:21:20 user nova-compute[74701]:   <name>instance-00000020</name>
Oct 20 13:21:20 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:21:20 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:21:20 user nova-compute[74701]:   <metadata>
Oct 20 13:21:20 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:21:20 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-245423320</nova:name>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:21:20</nova:creationTime>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:21:20 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:21:20 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:owner>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:user uuid="22371d97e6c1416499916660b5b2b07e">tempest-AttachVolumeShelveTestJSON-1805146529-project-member</nova:user>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:project uuid="eaf15939da12479f9c7bfff1c4198efe">tempest-AttachVolumeShelveTestJSON-1805146529</nova:project>
Oct 20 13:21:20 user nova-compute[74701]:       </nova:owner>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:21:20 user nova-compute[74701]:       <nova:ports>
Oct 20 13:21:20 user nova-compute[74701]:         <nova:port uuid="3753e7a7-d8ec-4e83-a888-19793f0d839a">
Oct 20 13:21:20 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:21:20 user nova-compute[74701]:         </nova:port>
Oct 20 13:21:20 user nova-compute[74701]:       </nova:ports>
Oct 20 13:21:20 user nova-compute[74701]:     </nova:instance>
Oct 20 13:21:20 user nova-compute[74701]:   </metadata>
Oct 20 13:21:20 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:21:20 user nova-compute[74701]:     <system>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="serial">8fc7fb59-af87-4358-a67f-1f2d6abb9a56</entry>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="uuid">8fc7fb59-af87-4358-a67f-1f2d6abb9a56</entry>
Oct 20 13:21:20 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:21:20 user nova-compute[74701]:     </system>
Oct 20 13:21:20 user nova-compute[74701]:   </sysinfo>
Oct 20 13:21:20 user nova-compute[74701]:   <os>
Oct 20 13:21:20 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:21:20 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:21:20 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:21:20 user nova-compute[74701]:   </os>
Oct 20 13:21:20 user nova-compute[74701]:   <features>
Oct 20 13:21:20 user nova-compute[74701]:     <acpi/>
Oct 20 13:21:20 user nova-compute[74701]:     <apic/>
Oct 20 13:21:20 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:21:20 user nova-compute[74701]:   </features>
Oct 20 13:21:20 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:21:20 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:21:20 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:21:20 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:21:20 user nova-compute[74701]:   </clock>
Oct 20 13:21:20 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:21:20 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:21:20 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:21:20 user nova-compute[74701]:   </cpu>
Oct 20 13:21:20 user nova-compute[74701]:   <devices>
Oct 20 13:21:20 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:21:20 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:21:20 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk"/>
Oct 20 13:21:20 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:21:20 user nova-compute[74701]:     </disk>
Oct 20 13:21:20 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:21:20 user nova-compute[74701]:       <mac address="fa:16:3e:d2:54:76"/>
Oct 20 13:21:20 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:21:20 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:21:20 user nova-compute[74701]:       <target dev="tap3753e7a7-d8"/>
Oct 20 13:21:20 user nova-compute[74701]:     </interface>
Oct 20 13:21:20 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:21:20 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/console.log" append="off"/>
Oct 20 13:21:20 user nova-compute[74701]:     </serial>
Oct 20 13:21:20 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:21:20 user nova-compute[74701]:     <video>
Oct 20 13:21:20 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:21:20 user nova-compute[74701]:     </video>
Oct 20 13:21:20 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:21:20 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:21:20 user nova-compute[74701]:     </rng>
Oct 20 13:21:20 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:21:20 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:21:20 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:21:20 user nova-compute[74701]:     </memballoon>
Oct 20 13:21:20 user nova-compute[74701]:   </devices>
Oct 20 13:21:20 user nova-compute[74701]: </domain>
Oct 20 13:21:20 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOyiLPG43sf8nTt6IdNQyV81L+L8gnxG8o7EsoHItaOu4r39dqcrkLJviW7zglttU3kDgBbImUjSllgkkT2IT1V2vOgacq/jGB69IMuUKNL2UNlpPrglBw/MA7ykxyY2Q==',key_name='tempest-keypair-194972029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG os_vif [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29d5ad96-908f-577d-bb71-d7c8bcf7b689', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3753e7a7-d8, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3753e7a7-d8, col_values=(('qos', UUID('ed65f563-f735-431c-afa7-569bd3de2e98')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3753e7a7-d8, col_values=(('external_ids', {'iface-id': '3753e7a7-d8ec-4e83-a888-19793f0d839a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:54:76', 'vm-uuid': '8fc7fb59-af87-4358-a67f-1f2d6abb9a56'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:20 user nova-compute[74701]: INFO os_vif [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8')
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No VIF found with MAC fa:16:3e:d2:54:76, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updated VIF entry in instance network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG nova.network.neutron [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5bfa8294-56ee-4507-847a-dccb56bd8b6e req-725822a3-12b3-45e8-83d2-76e70f0f3eca service nova] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:21:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:22 user nova-compute[74701]: WARNING nova.compute.manager [req-84b10170-5435-419d-a227-4bb60d48bca6 req-b0492bfa-e8e0-45a4-b541-52661630b16e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state building and task_state spawning.
Oct 20 13:21:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:21:24 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance spawned successfully.
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:24 user nova-compute[74701]: WARNING nova.compute.manager [req-9e2eda5c-5c7b-4017-a3db-6747fd4fd1fc req-27fe332c-bab8-47c0-b98f-9a01b5e6b8e4 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state building and task_state spawning.
Oct 20 13:21:24 user nova-compute[74701]: INFO nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 20 13:21:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:21:24 user nova-compute[74701]: INFO nova.compute.manager [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Took 7.22 seconds to build instance.
Oct 20 13:21:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a45d20f4-8b69-464f-9c0d-ed6496b46c50 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.332s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:30 user nova-compute[74701]: INFO nova.compute.manager [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Terminating instance
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-99aed8f2-6898-41e6-9c75-af0737d93617 req-27f85991-6f1e-4d3f-b355-4331ce4b68b4 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-unplugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Instance destroyed successfully.
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.objects.instance [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid d15383e1-cb58-4069-82ae-d1ceaa1a2e7f {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-137752104',display_name='tempest-ServerRescueNegativeTestJSON-server-137752104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-137752104',id=23,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6MyZeHF4TZQ95c9gGZafULpwah2Iu6lvsYuO+mdk/qOBWWK1mxLCvBr/3EFUp97kcu/X57uaE51+1q+RKkvWqujl8tjbpHTzQ94H6HfvS6hcaUagYQmFny1qLvJ6dvpg==',key_name='tempest-keypair-869580081',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-qxa6mm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d15383e1-cb58-4069-82ae-d1ceaa1a2e7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "address": "fa:16:3e:df:20:71", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf1252a-32", "ovs_interfaceid": "0bf1252a-3258-4278-80d1-bff6c2aad9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG os_vif [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bf1252a-32, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97a2c90d-1822-47fc-8b30-2afd9b97dbf3) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:30 user nova-compute[74701]: INFO os_vif [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:20:71,bridge_name='br-int',has_traffic_filtering=True,id=0bf1252a-3258-4278-80d1-bff6c2aad9cb,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf1252a-32')
Oct 20 13:21:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Deleting instance files /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f_del
Oct 20 13:21:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Deletion of /opt/stack/data/nova/instances/d15383e1-cb58-4069-82ae-d1ceaa1a2e7f_del complete
Oct 20 13:21:30 user nova-compute[74701]: INFO nova.compute.manager [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 13:21:30 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:21:30 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:21:31 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:31 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Took 0.77 seconds to deallocate network for instance.
Oct 20 13:21:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-678dfcc5-204a-4256-84bf-cd7ca916cd07 req-2ca6863a-48dd-4f84-a444-402036e5e693 service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-deleted-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:32 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Deleted allocations for instance d15383e1-cb58-4069-82ae-d1ceaa1a2e7f
Oct 20 13:21:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-da5b1a92-a2af-46f6-972d-8c485d89dd47 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] Acquiring lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] Lock "d15383e1-cb58-4069-82ae-d1ceaa1a2e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] No waiting events found dispatching network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:32 user nova-compute[74701]: WARNING nova.compute.manager [req-aedfbd2a-fe4c-4d71-ab3d-765077059d08 req-36d5bcb5-7e76-460a-bb57-ca43d689c0df service nova] [instance: d15383e1-cb58-4069-82ae-d1ceaa1a2e7f] Received unexpected event network-vif-plugged-0bf1252a-3258-4278-80d1-bff6c2aad9cb for instance with vm_state deleted and task_state None.
Oct 20 13:21:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:43 user nova-compute[74701]: INFO nova.compute.manager [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Terminating instance
Oct 20 13:21:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-unplugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] No waiting events found dispatching network-vif-unplugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-ddd83b86-90be-4de0-a9ea-5e3092167efd req-49d3866c-beee-4d62-a821-c75d13c3b437 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-unplugged-79d66644-4692-4730-9f7e-7dbfe1814f7d for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Instance destroyed successfully.
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.objects.instance [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lazy-loading 'resources' on Instance uuid bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-221019941',display_name='tempest-ServersNegativeTestJSON-server-221019941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-221019941',id=16,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff75c095f4304b76b10c26ee8e8cc489',ramdisk_id='',reservation_id='r-j054vlh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1044364652',owner_user_name='tempest-ServersNegativeTestJSON-1044364652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:12:28Z,user_data=None,user_id='5e7c09b687b54750aceb6e2d4ddce16f',uuid=bbccb7d3-1e40-4e4e-9a8a-c012b73dc397,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converting VIF {"id": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "address": "fa:16:3e:06:1f:af", "network": {"id": "ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-805209100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff75c095f4304b76b10c26ee8e8cc489", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d66644-46", "ovs_interfaceid": "79d66644-4692-4730-9f7e-7dbfe1814f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG os_vif [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d66644-46, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6055a56-0630-40fe-bcf3-067ce22d48d6) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:44 user nova-compute[74701]: INFO os_vif [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1f:af,bridge_name='br-int',has_traffic_filtering=True,id=79d66644-4692-4730-9f7e-7dbfe1814f7d,network=Network(ec8dc3dd-9d90-41f4-9ab3-d9d81e971d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d66644-46')
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Deleting instance files /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397_del
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Deletion of /opt/stack/data/nova/instances/bbccb7d3-1e40-4e4e-9a8a-c012b73dc397_del complete
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.compute.manager [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 20 13:21:44 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Took 0.58 seconds to deallocate network for instance.
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-0178e9be-f187-4b62-bb44-8694f7df5604 req-767ae36a-428d-4b27-b1e7-b426104e0762 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-deleted-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:44 user nova-compute[74701]: INFO nova.compute.manager [req-0178e9be-f187-4b62-bb44-8694f7df5604 req-767ae36a-428d-4b27-b1e7-b426104e0762 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Neutron deleted interface 79d66644-4692-4730-9f7e-7dbfe1814f7d; detaching it from the instance and deleting it from the info cache
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.network.neutron [req-0178e9be-f187-4b62-bb44-8694f7df5604 req-767ae36a-428d-4b27-b1e7-b426104e0762 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-0178e9be-f187-4b62-bb44-8694f7df5604 req-767ae36a-428d-4b27-b1e7-b426104e0762 service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Detach interface failed, port_id=79d66644-4692-4730-9f7e-7dbfe1814f7d, reason: Instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:45 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Deleted allocations for instance bbccb7d3-1e40-4e4e-9a8a-c012b73dc397
Oct 20 13:21:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-fce99273-7de7-42a6-951f-13e8d085e69b tempest-ServersNegativeTestJSON-1044364652 tempest-ServersNegativeTestJSON-1044364652-project-member] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] Acquiring lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] Lock "bbccb7d3-1e40-4e4e-9a8a-c012b73dc397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] No waiting events found dispatching network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:45 user nova-compute[74701]: WARNING nova.compute.manager [req-918e01e8-1a09-4312-b467-6149b9371c7f req-c760a22e-8374-4bfd-adb5-20fe44b54dbb service nova] [instance: bbccb7d3-1e40-4e4e-9a8a-c012b73dc397] Received unexpected event network-vif-plugged-79d66644-4692-4730-9f7e-7dbfe1814f7d for instance with vm_state deleted and task_state None.
Oct 20 13:21:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRSMPTho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:21:46 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:21:46 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:21:46 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba2d2d-ef50-41ed-afd2-8503fc66c527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:21:46 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e2cd5-24b4-4a3a-b731-a7504bcd9acd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134] added
Oct 20 13:21:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d978884f-c583-47bc-9d00-f2b5f2117713]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346d842-2bec-4e84-99cb-ad642f4074ac]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRSMPTho {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRSMPTho" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916a3c6-7cee-4c96-8d3b-508a4177b8eb]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRSMPTho'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6deb02-ff9d-4ef4-898d-6eaa0793b9d3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4654439-d074-469a-adbd-0492cd2b8ddc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a0657-df9b-47aa-86fe-d368b498a191]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260]
Oct 20 13:21:47 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260] successful.
Oct 20 13:21:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3052dfa-3053-4d3c-a677-960ada5a7c87]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d1776-7b66-4d45-a5c2-4f09ca4bb4cd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:47 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:21:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279bf05-e239-4f8f-b88d-648c6da1c324]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:21:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRSMPTho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26636303932666565', 'path': '/dev/sde'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636303932666565', 'path': '/dev/sde'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:21:48 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:21:48 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:21:48 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:21:48 user nova-compute[74701]:   <serial>4c17f494-283b-45b5-9c39-3b236a8e4134</serial>
Oct 20 13:21:48 user nova-compute[74701]: </disk>
Oct 20 13:21:48 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No VIF found with MAC fa:16:3e:f6:19:84, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:21:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d2477d2e-2584-4e6e-bc4a-922db5b83a73 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.388s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:49 user nova-compute[74701]: INFO nova.compute.manager [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Terminating instance
Oct 20 13:21:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-855a92b3-026c-4976-bf5f-76d9c1cacb85 req-856c1f6d-6008-45e1-83cd-035902383609 service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-unplugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:21:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Instance destroyed successfully.
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lazy-loading 'resources' on Instance uuid e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-950766450',display_name='tempest-ServerActionsTestOtherB-server-950766450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-950766450',id=17,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoHo5uaTyjiUZBbkB+LvkY+WWTj4QoHCkxntDRlCjK5BT7RSPQTbNFZsLFgqnUCI/KJfCrMkUfj8wWMvdu+ftnZ6QB3XgSspx/P96/ZYfojdMK8fAnoxr+PAns5lkRffQ==',key_name='tempest-keypair-1502966901',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9321569f0e5b4ca49120669fcd48f80b',ramdisk_id='',reservation_id='r-ili6kouu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1560345207',owner_user_name='tempest-ServerActionsTestOtherB-1560345207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600c832acd2409c973cfa387a018967',uuid=e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converting VIF {"id": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "address": "fa:16:3e:db:3b:2b", "network": {"id": "9a35df6c-6263-49de-a27c-6193a4fa08e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1077585176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9321569f0e5b4ca49120669fcd48f80b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbb1918-8d", "ovs_interfaceid": "ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_vif [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffbb1918-8d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9b097c3-5afe-4205-8c6a-dd1887bc4208) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:21:50 user nova-compute[74701]: INFO os_vif [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:3b:2b,bridge_name='br-int',has_traffic_filtering=True,id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4,network=Network(9a35df6c-6263-49de-a27c-6193a4fa08e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbb1918-8d')
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdwRCSFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:21:50 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e1d08-17c0-4451-b6fd-03cc7e491e7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:21:50 user nova-compute[74701]: No targets found.
Oct 20 13:21:50 user nova-compute[74701]: iSNS:
Oct 20 13:21:50 user nova-compute[74701]: No targets found.
Oct 20 13:21:50 user nova-compute[74701]: STATIC:
Oct 20 13:21:50 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:21:50 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:50 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:50 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e
Oct 20 13:21:50 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:50 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:50 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134
Oct 20 13:21:50 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:50 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:50 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc
Oct 20 13:21:50 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:21:50 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:21:50 user nova-compute[74701]: FIRMWARE:
Oct 20 13:21:50 user nova-compute[74701]: No targets found.
Oct 20 13:21:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:21:50 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:21:50 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5115cb5a-4dc1-456a-a902-388487e65ae4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac5be9-255b-4de8-a3e4-6a6e5e726981]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:21:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6501f97-196f-4bdb-8ecb-138889b32a2e (non-flash)
Oct 20 13:21:50 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:21:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc623a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[293f8e91-686f-4669-8ad9-45b866075fa5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[389dccc6-3542-4dd7-8d53-78dd11039cfb]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[077aa168-7d22-43b9-b8ef-59d555f8e04d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca773e-2f67-4e5f-80f9-144a9356ecd7]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c42f36-6092-44f0-8220-5506a37718de]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfbd20-1737-4cf4-ac63-f0e66cde47b7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260]
Oct 20 13:21:50 user nova-compute[74701]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc, portal: 172.16.0.220,3260] successful.
Oct 20 13:21:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7152b709-3534-4f9f-a44d-8495533202dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1462c772-3d9f-4423-8c98-7e829c4c7661]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] <== disconnect_volume: return (355ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:21:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Deleting instance files /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_del
Oct 20 13:21:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Deletion of /opt/stack/data/nova/instances/e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41_del complete
Oct 20 13:21:50 user nova-compute[74701]: INFO nova.compute.manager [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Took 1.49 seconds to destroy the instance on the hypervisor.
Oct 20 13:21:50 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:21:50 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] Acquiring lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] No waiting events found dispatching network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:21:51 user nova-compute[74701]: WARNING nova.compute.manager [req-4859da01-5b5a-4cc3-8231-0cd342364b57 req-81fc7bc5-0ef3-4fdb-929f-0f55acb83a2b service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received unexpected event network-vif-plugged-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 for instance with vm_state active and task_state deleting.
Oct 20 13:21:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:51 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Took 1.25 seconds to deallocate network for instance.
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-605b9f54-8997-4d37-bd09-fe5f84922e5d req-0a74ef4f-b020-4260-9d1d-692d1ae928de service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Received event network-vif-deleted-ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:21:51 user nova-compute[74701]: INFO nova.compute.manager [req-605b9f54-8997-4d37-bd09-fe5f84922e5d req-0a74ef4f-b020-4260-9d1d-692d1ae928de service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Neutron deleted interface ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4; detaching it from the instance and deleting it from the info cache
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-605b9f54-8997-4d37-bd09-fe5f84922e5d req-0a74ef4f-b020-4260-9d1d-692d1ae928de service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:21:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-605b9f54-8997-4d37-bd09-fe5f84922e5d req-0a74ef4f-b020-4260-9d1d-692d1ae928de service nova] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Detach interface failed, port_id=ffbb1918-8d89-4d38-b27e-6bb0c2b81ef4, reason: Instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:21:53 user nova-compute[74701]: INFO nova.compute.manager [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] [instance: e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41] Took 1.13 seconds to detach 1 volumes for instance.
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:21:53 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Deleted allocations for instance e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-11f9c82f-cf0c-4905-bd6d-338d7e87ef52 tempest-ServerActionsTestOtherB-1560345207 tempest-ServerActionsTestOtherB-1560345207-project-member] Lock "e0d3d6e7-7baf-4cfa-8286-ee7cedc8ab41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.698s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:21:54 user nova-compute[74701]: INFO nova.compute.manager [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attaching volume 259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f to /dev/vdc
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.utils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebfc6f-de1a-44b8-9a02-723285d6c0f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3cdd64-f03c-47a0-95e1-1b9f1c7495a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c33718-9dc6-47f7-8cdd-2dbc8967674a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[898cc3e4-2bda-4f9c-9b6b-c50127954ebc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:21:54 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:21:54 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c203a23d-438f-4bbe-a1ca-c4d09fda1305]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG os_brick.utils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:21:54 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating existing volume attachment record: 6742767c-a2dd-4cab-ac5e-b0744792b02f {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:21:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:21:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:22:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:00 user nova-compute[74701]: INFO nova.compute.manager [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] instance snapshotting
Oct 20 13:22:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Beginning live snapshot process
Oct 20 13:22:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json -f qcow2" returned: 0 in 0.306s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json -f qcow2" returned: 0 in 0.283s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.312s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3.delta 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3.delta 1073741824" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:01 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:22:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:22:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 10878976 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 18677760 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:22:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:22:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3.delta /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:22:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3.delta /opt/stack/data/nova/instances/snapshots/tmp6g5x_c4y/93b713fa10c048869b756af2512dfbd3" returned: 0 in 2.167s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Snapshot extracted, beginning image upload
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:22:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7793MB free_disk=24.282878875732422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0fd5f037-78df-4001-97b6-d4fec57b87d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:22:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:22:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:22:09 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Snapshot image upload complete
Oct 20 13:22:09 user nova-compute[74701]: INFO nova.compute.manager [None req-8ded04aa-ccf6-4107-b75d-82814f5e2082 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Took 9.42 seconds to snapshot the instance on the hypervisor.
Oct 20 13:22:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:22:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdWiqouf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:22:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:22:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:22:13 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d081b175-ee91-40ab-bce1-d9346ddf3d1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:22:13 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ae5c4a-0af8-46cb-b2e6-0d84c3d4f7c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f] added
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab4a3f-758b-44eb-a130-8beaa340371e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a5d5a-5c86-44ac-82ec-e36d871019cf]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdWiqouf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdWiqouf" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f8b9f8-95f7-4e9d-85f0-0924c1a92c42]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdWiqouf'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[76636451-712a-4c9a-aeea-3a5e1cb311c6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b25308-5897-4c1d-afbd-e22a365739b6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d46cd-605e-4509-95cd-fca9d2e4e80c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260]
Oct 20 13:22:13 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260] successful.
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08fe30-2162-4202-a84d-d800a5ca278f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65cacb-d906-495d-ba35-a4a2a6415b6f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:13 user nova-compute[74701]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)
Oct 20 13:22:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940be03-d6b1-43e6-bb90-1b5921b5d7ed]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:22:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdWiqouf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:22:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:22:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26566626335333736', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:22:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566626335333736', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:22:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:22:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:22:14 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:22:14 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:22:14 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:22:14 user nova-compute[74701]:   <serial>259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f</serial>
Oct 20 13:22:14 user nova-compute[74701]: </disk>
Oct 20 13:22:14 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] No VIF found with MAC fa:16:3e:f6:19:84, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47bc1e36-10bb-4397-b1cc-758f542f9635 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.240s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:16 user nova-compute[74701]: INFO nova.compute.manager [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Detaching volume 259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f
Oct 20 13:22:16 user nova-compute[74701]: INFO nova.virt.block_device [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attempting to driver detach volume 259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f from mountpoint /dev/vdc
Oct 20 13:22:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Attempting to detach device vdc from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:22:16 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:22:16 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:22:16 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:22:16 user nova-compute[74701]:   <serial>259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f</serial>
Oct 20 13:22:16 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:22:16 user nova-compute[74701]: </disk>
Oct 20 13:22:16 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:22:16 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully detached device vdc from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the persistent domain config.
Oct 20 13:22:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:22:16 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:22:16 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:22:16 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:22:16 user nova-compute[74701]:   <serial>259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f</serial>
Oct 20 13:22:16 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:22:16 user nova-compute[74701]: </disk>
Oct 20 13:22:16 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:22:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:22:35 user nova-compute[74701]: INFO nova.compute.claims [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Claim successful on node user
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:22:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:22:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.policy [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '819014923a4d471fa9a109ba59da3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d12fee426e4728a322fc03e1f2d506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:22:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Creating image(s)
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "/opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "/opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:36 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 is timed out.
Oct 20 13:22:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully detached device vdc from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the live domain config.
Oct 20 13:22:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdWiqouf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:22:36 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3f590-c4f3-401e-aad2-bd353963983e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:22:36 user nova-compute[74701]: No targets found.
Oct 20 13:22:36 user nova-compute[74701]: iSNS:
Oct 20 13:22:36 user nova-compute[74701]: No targets found.
Oct 20 13:22:36 user nova-compute[74701]: STATIC:
Oct 20 13:22:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:22:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:22:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:22:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f
Oct 20 13:22:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:22:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:22:36 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134
Oct 20 13:22:36 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:22:36 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:22:36 user nova-compute[74701]: FIRMWARE:
Oct 20 13:22:36 user nova-compute[74701]: No targets found.
Oct 20 13:22:36 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:22:36 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:22:36 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26804d-cde9-411b-988f-9598b8da8c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk 1073741824" returned: 0 in 0.063s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f584488b-7077-4619-b7bc-a6be8c547f9e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:37 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:37 user nova-compute[74701]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)
Oct 20 13:22:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:22:37 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:22:37 user nova-compute[74701]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f (non-flash)
Oct 20 13:22:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f87000fd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc9424a-ec50-4e5a-9494-4e6c9c284a0f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c3ed1-1ebb-4649-afc9-326a6557eb58]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5de0cb-574f-4f87-9674-adf282794083]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4df62e-901c-43b3-80b9-90b110076b96]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfcdde2-8eb1-4306-b57b-d99b93a053b7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca01b2-86d3-4264-94d3-8059271b6b5f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260]
Oct 20 13:22:37 user nova-compute[74701]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f, portal: 172.16.0.220,3260] successful.
Oct 20 13:22:37 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Cannot resize image /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:259be1f5-3f0f-454a-87bd-2b0e7ef2ab4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c85185-e549-4a32-aa24-d035f0543813]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.559s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== disconnect_volume: return (561ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:22:37 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Successfully created port: 4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Successfully updated port: 4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquired lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.objects.instance [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-aa6c432f-e3da-4a94-a663-03b926c1e6f9 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.193s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing instance network info cache due to event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:22:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] Acquiring lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Releasing lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Instance network_info: |[{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] Acquired lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Start _get_guest_xml network_info=[{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:22:39 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:22:39 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1217431802',display_name='tempest-TestStampPattern-server-1217431802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1217431802',id=33,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-4mznt842',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:22:36Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=f5fa149e-2c53-42c6-8582-8dc13ea18857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.objects.instance [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:22:39 user nova-compute[74701]:   <uuid>f5fa149e-2c53-42c6-8582-8dc13ea18857</uuid>
Oct 20 13:22:39 user nova-compute[74701]:   <name>instance-00000021</name>
Oct 20 13:22:39 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:22:39 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:22:39 user nova-compute[74701]:   <metadata>
Oct 20 13:22:39 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:22:39 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:name>tempest-TestStampPattern-server-1217431802</nova:name>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:22:39</nova:creationTime>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:22:39 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:22:39 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:owner>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:user uuid="819014923a4d471fa9a109ba59da3ed5">tempest-TestStampPattern-1055047061-project-member</nova:user>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:project uuid="04d12fee426e4728a322fc03e1f2d506">tempest-TestStampPattern-1055047061</nova:project>
Oct 20 13:22:39 user nova-compute[74701]:       </nova:owner>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:22:39 user nova-compute[74701]:       <nova:ports>
Oct 20 13:22:39 user nova-compute[74701]:         <nova:port uuid="4860330a-feb1-4b0e-8b1e-6f45fbc66780">
Oct 20 13:22:39 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:22:39 user nova-compute[74701]:         </nova:port>
Oct 20 13:22:39 user nova-compute[74701]:       </nova:ports>
Oct 20 13:22:39 user nova-compute[74701]:     </nova:instance>
Oct 20 13:22:39 user nova-compute[74701]:   </metadata>
Oct 20 13:22:39 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:22:39 user nova-compute[74701]:     <system>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="serial">f5fa149e-2c53-42c6-8582-8dc13ea18857</entry>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="uuid">f5fa149e-2c53-42c6-8582-8dc13ea18857</entry>
Oct 20 13:22:39 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:22:39 user nova-compute[74701]:     </system>
Oct 20 13:22:39 user nova-compute[74701]:   </sysinfo>
Oct 20 13:22:39 user nova-compute[74701]:   <os>
Oct 20 13:22:39 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:22:39 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:22:39 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:22:39 user nova-compute[74701]:   </os>
Oct 20 13:22:39 user nova-compute[74701]:   <features>
Oct 20 13:22:39 user nova-compute[74701]:     <acpi/>
Oct 20 13:22:39 user nova-compute[74701]:     <apic/>
Oct 20 13:22:39 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:22:39 user nova-compute[74701]:   </features>
Oct 20 13:22:39 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:22:39 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:22:39 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:22:39 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:22:39 user nova-compute[74701]:   </clock>
Oct 20 13:22:39 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:22:39 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:22:39 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:22:39 user nova-compute[74701]:   </cpu>
Oct 20 13:22:39 user nova-compute[74701]:   <devices>
Oct 20 13:22:39 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:22:39 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:22:39 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk"/>
Oct 20 13:22:39 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:22:39 user nova-compute[74701]:     </disk>
Oct 20 13:22:39 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:22:39 user nova-compute[74701]:       <mac address="fa:16:3e:fa:f9:0c"/>
Oct 20 13:22:39 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:22:39 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:22:39 user nova-compute[74701]:       <target dev="tap4860330a-fe"/>
Oct 20 13:22:39 user nova-compute[74701]:     </interface>
Oct 20 13:22:39 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:22:39 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/console.log" append="off"/>
Oct 20 13:22:39 user nova-compute[74701]:     </serial>
Oct 20 13:22:39 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:22:39 user nova-compute[74701]:     <video>
Oct 20 13:22:39 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:22:39 user nova-compute[74701]:     </video>
Oct 20 13:22:39 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:22:39 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:22:39 user nova-compute[74701]:     </rng>
Oct 20 13:22:39 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:22:39 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:22:39 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:22:39 user nova-compute[74701]:     </memballoon>
Oct 20 13:22:39 user nova-compute[74701]:   </devices>
Oct 20 13:22:39 user nova-compute[74701]: </domain>
Oct 20 13:22:39 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1217431802',display_name='tempest-TestStampPattern-server-1217431802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1217431802',id=33,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-4mznt842',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:22:36Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=f5fa149e-2c53-42c6-8582-8dc13ea18857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG os_vif [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bdf616d-3e4d-58d5-ad15-3003291726fc', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4860330a-fe, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4860330a-fe, col_values=(('qos', UUID('e3cfdad4-4edb-47b1-bf28-53098168bad9')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4860330a-fe, col_values=(('external_ids', {'iface-id': '4860330a-feb1-4b0e-8b1e-6f45fbc66780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:f9:0c', 'vm-uuid': 'f5fa149e-2c53-42c6-8582-8dc13ea18857'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:39 user nova-compute[74701]: INFO os_vif [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe')
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No VIF found with MAC fa:16:3e:fa:f9:0c, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updated VIF entry in instance network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:22:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ad0f20f3-c4a4-43ad-938f-83b2e1bbfc1c req-e27d2770-45b8-4870-a22c-6cc1b8495d6f service nova] Releasing lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:22:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] No waiting events found dispatching network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:22:41 user nova-compute[74701]: WARNING nova.compute.manager [req-4bf4f92f-92c0-4cd6-8fc8-4f1efbad725c req-df12f991-e21f-4dc0-8120-ff4ab5612737 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received unexpected event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 for instance with vm_state building and task_state spawning.
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 372102fa-399b-4ae2-8c73-23b250e4d790 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 611fd7ef-e138-4a36-b1ab-5d948038429a {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:42 user nova-compute[74701]: INFO nova.compute.manager [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Terminating instance
Oct 20 13:22:42 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Instance destroyed successfully.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid 0fd5f037-78df-4001-97b6-d4fec57b87d5 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] No waiting events found dispatching network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:22:43 user nova-compute[74701]: WARNING nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received unexpected event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 for instance with vm_state building and task_state spawning.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-unplugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Acquiring lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] No waiting events found dispatching network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:22:43 user nova-compute[74701]: WARNING nova.compute.manager [req-74071749-085b-4f71-b852-6916eacf3295 req-052b1b3d-67b4-4616-bdf5-baa0d51b56f3 service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received unexpected event network-vif-plugged-dceb5cbd-d231-44b8-95fd-a2693ee7831a for instance with vm_state rescued and task_state deleting.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397688832',display_name='tempest-ServerRescueNegativeTestJSON-server-1397688832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397688832',id=3,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-vbunpiby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:07:58Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=0fd5f037-78df-4001-97b6-d4fec57b87d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "address": "fa:16:3e:f0:91:6b", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdceb5cbd-d2", "ovs_interfaceid": "dceb5cbd-d231-44b8-95fd-a2693ee7831a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG os_vif [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdceb5cbd-d2, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbe99fb1-7a6a-4a6a-a3a0-736d037a3f40) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:22:43 user nova-compute[74701]: INFO os_vif [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:6b,bridge_name='br-int',has_traffic_filtering=True,id=dceb5cbd-d231-44b8-95fd-a2693ee7831a,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdceb5cbd-d2')
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Deleting instance files /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5_del
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Deletion of /opt/stack/data/nova/instances/0fd5f037-78df-4001-97b6-d4fec57b87d5_del complete
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.compute.manager [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Instance spawned successfully.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Took 6.87 seconds to spawn the instance on the hypervisor.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.compute.manager [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Took 8.06 seconds to build instance.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47719c05-f614-4a8b-add6-7fe50c31c958 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.173s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.366s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 13:22:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:43 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:22:43 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Took 0.60 seconds to deallocate network for instance.
Oct 20 13:22:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:22:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:22:44 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:22:44 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:22:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:44 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Deleted allocations for instance 0fd5f037-78df-4001-97b6-d4fec57b87d5
Oct 20 13:22:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9a1cdb7b-c67a-480d-bbba-3c0e8da79ba7 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "0fd5f037-78df-4001-97b6-d4fec57b87d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:22:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-760a5581-b79b-491f-8dc6-4d205660bfb2 req-00ade1dd-5495-41f2-9552-54fe6ab6ff1a service nova] [instance: 0fd5f037-78df-4001-97b6-d4fec57b87d5] Received event network-vif-deleted-dceb5cbd-d231-44b8-95fd-a2693ee7831a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:22:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:22:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:02 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:23:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:06 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:23:06 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:23:06 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=24.974407196044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:07 user nova-compute[74701]: INFO nova.compute.manager [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Detaching volume 4c17f494-283b-45b5-9c39-3b236a8e4134
Oct 20 13:23:07 user nova-compute[74701]: INFO nova.virt.block_device [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Attempting to driver detach volume 4c17f494-283b-45b5-9c39-3b236a8e4134 from mountpoint /dev/vdb
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Attempting to detach device vdb from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:23:07 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:23:07 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:23:07 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:23:07 user nova-compute[74701]:   <serial>4c17f494-283b-45b5-9c39-3b236a8e4134</serial>
Oct 20 13:23:07 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:23:07 user nova-compute[74701]: </disk>
Oct 20 13:23:07 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:23:07 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully detached device vdb from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the persistent domain config.
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:23:07 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:23:07 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:23:07 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:23:07 user nova-compute[74701]:   <serial>4c17f494-283b-45b5-9c39-3b236a8e4134</serial>
Oct 20 13:23:07 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:23:07 user nova-compute[74701]: </disk>
Oct 20 13:23:07 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing instance network info cache due to event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updated VIF entry in instance network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.network.neutron [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fcbf646f-7943-40b5-a9bc-00b9d441a49b req-7506f4b6-9258-4c88-9008-9f656076a604 service nova] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:23:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:23:12 user nova-compute[74701]: INFO nova.compute.claims [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Claim successful on node user
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:23:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:23:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:23:13 user nova-compute[74701]: INFO nova.virt.block_device [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Booting with volume-backed-image 5624a009-5482-4bf8-9162-de2cb54fd34f at /dev/vda
Oct 20 13:23:13 user nova-compute[74701]: DEBUG nova.policy [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '751a8755f9774b1da2e71623164c40b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed52bceb45147ceb782e49acf3a9d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:23:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Successfully created port: ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Successfully updated port: ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-changed-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.compute.manager [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Refreshing instance network info cache due to event network-changed-ca30b384-8335-4b08-87c7-2b817067acb5. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] Acquiring lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating instance_info_cache with network_info: [{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance network_info: |[{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] Acquired lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Refreshing network info cache for port ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:16 user nova-compute[74701]: INFO nova.compute.manager [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Shelving
Oct 20 13:23:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updated VIF entry in instance network info cache for port ca30b384-8335-4b08-87c7-2b817067acb5. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG nova.network.neutron [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating instance_info_cache with network_info: [{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c937d07f-73a7-41fa-ad8a-8d74884470b2 req-7d3bcb4e-393b-4c75-82b0-d5de3d5c5808 service nova] Releasing lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:16 user nova-compute[74701]: WARNING nova.compute.manager [req-eede20bb-a916-4ad7-b194-43f300ee29a1 req-4dfb0f4f-04f0-477d-9b18-a01638539dfc service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state active and task_state shelving.
Oct 20 13:23:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance destroyed successfully.
Oct 20 13:23:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Beginning cold snapshot process
Oct 20 13:23:17 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:23:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk /opt/stack/data/nova/instances/snapshots/tmpeilwawed/eda77bf959194f90a1cf8ffecdc4a213 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk /opt/stack/data/nova/instances/snapshots/tmpeilwawed/eda77bf959194f90a1cf8ffecdc4a213" returned: 0 in 0.973s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Snapshot extracted, beginning image upload
Oct 20 13:23:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:18 user nova-compute[74701]: WARNING nova.compute.manager [req-28cad649-f823-4140-a32f-502d50b6d769 req-ec7be58e-bedd-4925-9dbd-2a906d9d9d21 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 13:23:21 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Snapshot image upload complete
Oct 20 13:23:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:23:21 user nova-compute[74701]: INFO nova.compute.manager [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Shelve offloading
Oct 20 13:23:21 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance destroyed successfully.
Oct 20 13:23:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:23:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:21 user nova-compute[74701]: DEBUG nova.network.neutron [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:22 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance destroyed successfully.
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.objects.instance [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'resources' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOyiLPG43sf8nTt6IdNQyV81L+L8gnxG8o7EsoHItaOu4r39dqcrkLJviW7zglttU3kDgBbImUjSllgkkT2IT1V2vOgacq/jGB69IMuUKNL2UNlpPrglBw/MA7ykxyY2Q==',key_name='tempest-keypair-194972029',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:23:21.355168',shelved_host='user',shelved_image_id='57dd95cf-8ed8-45b5-9325-3a125a901fb6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG os_vif [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3753e7a7-d8, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing instance network info cache due to event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG nova.network.neutron [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed65f563-f735-431c-afa7-569bd3de2e98) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:22 user nova-compute[74701]: INFO os_vif [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8')
Oct 20 13:23:22 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Deleting instance files /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56_del
Oct 20 13:23:22 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Deletion of /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56_del complete
Oct 20 13:23:22 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Deleted allocations for instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56
Oct 20 13:23:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.objects.instance [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.objects.base [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<8fc7fb59-af87-4358-a67f-1f2d6abb9a56> lazy-loaded attributes: resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.network.neutron [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updated VIF entry in instance network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG nova.network.neutron [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95d79d6d-7a91-4a8f-9953-d72f2860e2ea req-c11f534d-fc53-4f72-9208-d38e14474608 service nova] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:23:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-15a26450-0101-417a-955d-82270250c902 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.372s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 is timed out.
Oct 20 13:23:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully detached device vdb from instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 from the live domain config.
Oct 20 13:23:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRSMPTho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:23:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec409cd-cc88-4bb2-86ef-c4ffed0c9cac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:23:27 user nova-compute[74701]: No targets found.
Oct 20 13:23:27 user nova-compute[74701]: iSNS:
Oct 20 13:23:27 user nova-compute[74701]: No targets found.
Oct 20 13:23:27 user nova-compute[74701]: STATIC:
Oct 20 13:23:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:23:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:23:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:23:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134
Oct 20 13:23:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:23:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:23:27 user nova-compute[74701]: FIRMWARE:
Oct 20 13:23:27 user nova-compute[74701]: No targets found.
Oct 20 13:23:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:23:27 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:23:27 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d875e61-c25d-434f-8894-66df48511222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c69c36b-ce7e-47a4-940c-a64ba4840f2a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:27 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:23:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:27 user nova-compute[74701]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 (non-flash)
Oct 20 13:23:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc622cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134'): ({'sde'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Removing single pathed devices sde {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fa253b-3288-4bf0-aa89-207438554e98]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb4afcb-7a3c-4920-bdfe-e3fe6d2a8709]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Flushing IO for device /dev/sde {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4bec7a-e02c-4cf0-a5b9-aa6a34133564]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e4e2d-4587-4fce-8d23-b73964b5d830]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0ef3d7-0a92-4b86-89c3-b3d89ea1f7b7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83aee7c-7be5-473b-a71f-c45ce9563101]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260]
Oct 20 13:23:28 user nova-compute[74701]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134, portal: 172.16.0.220,3260] successful.
Oct 20 13:23:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c17f494-283b-45b5-9c39-3b236a8e4134 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c6172f-1683-439f-8cf5-2eae3e8ee3dd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] <== disconnect_volume: return (327ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:23:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'flavor' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-72aa4c69-96cb-4bda-a01f-12d92dd3cd88 tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.042s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.utils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d20bb-d66e-4d82-9b46-32f7720aa33d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e2dbf8-a25d-46c9-9055-98d54072d304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48392a-674d-4f5e-910a-071a896575d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c74615-13b5-4e94-bb32-169ee35097d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:23:29 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:23:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7f6a7-ccde-4f00-9d9c-f00b5545e4c7]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG os_brick.utils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:23:29 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating existing volume attachment record: ea88a0e4-2452-4675-88a2-61a1bde7a2df {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:32 user nova-compute[74701]: INFO nova.compute.manager [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Terminating instance
Oct 20 13:23:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-5f3be263-90d7-4b82-ba53-c6fcda38e0cb req-12ac601e-4113-4404-96ea-17bc3ae5962e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-unplugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Instance destroyed successfully.
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lazy-loading 'resources' on Instance uuid d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-27796603',display_name='tempest-ServerRescueNegativeTestJSON-server-27796603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-27796603',id=2,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e48ad264d74341a6ee4c5d420385d0',ramdisk_id='',reservation_id='r-q76r6k3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-574725930',owner_user_name='tempest-ServerRescueNegativeTestJSON-574725930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:12:49Z,user_data=None,user_id='a5a2fb1012774de08b84f6593eae8073',uuid=d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converting VIF {"id": "84ab858b-9317-44ab-bb71-12ee8268501b", "address": "fa:16:3e:12:41:2d", "network": {"id": "4332a764-0527-44ed-907a-6d4e0e442d79", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-29974611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e48ad264d74341a6ee4c5d420385d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ab858b-93", "ovs_interfaceid": "84ab858b-9317-44ab-bb71-12ee8268501b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG os_vif [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84ab858b-93, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d7e214a-cda9-49ea-b66b-583de83e3f6e) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:33 user nova-compute[74701]: INFO os_vif [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:41:2d,bridge_name='br-int',has_traffic_filtering=True,id=84ab858b-9317-44ab-bb71-12ee8268501b,network=Network(4332a764-0527-44ed-907a-6d4e0e442d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ab858b-93')
Oct 20 13:23:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Deleting instance files /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2_del
Oct 20 13:23:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Deletion of /opt/stack/data/nova/instances/d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2_del complete
Oct 20 13:23:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:33 user nova-compute[74701]: INFO nova.compute.manager [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 20 13:23:33 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:23:33 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:34 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Took 0.73 seconds to deallocate network for instance.
Oct 20 13:23:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Deleted allocations for instance d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4b3af789-1d1c-411b-aa6b-87a90839adb0 tempest-ServerRescueNegativeTestJSON-574725930 tempest-ServerRescueNegativeTestJSON-574725930-project-member] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:35 user nova-compute[74701]: WARNING nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state deleted and task_state None.
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:35 user nova-compute[74701]: WARNING nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state deleted and task_state None.
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:35 user nova-compute[74701]: WARNING nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state deleted and task_state None.
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Acquiring lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] Lock "d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] No waiting events found dispatching network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:35 user nova-compute[74701]: WARNING nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received unexpected event network-vif-plugged-84ab858b-9317-44ab-bb71-12ee8268501b for instance with vm_state deleted and task_state None.
Oct 20 13:23:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-58dab7dc-7c82-4826-af49-014c43bf155f req-c8e73ca7-b4e8-4bce-b387-1373ba002d8e service nova] [instance: d6b6cf7f-2c48-4fbf-87b8-e6a9bbbdccb2] Received event network-vif-deleted-84ab858b-9317-44ab-bb71-12ee8268501b {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:23:47 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Creating image(s)
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Ensure instance console log exists: /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start _get_guest_xml network_info=[{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9dbb5296-c900-469d-8402-892639ec49ea', 'attached_at': '', 'detached_at': '', 'volume_id': '33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'serial': '33b52204-24ee-48ef-ab1c-6b0c666dc7bb'}, 'attachment_id': 'ea88a0e4-2452-4675-88a2-61a1bde7a2df', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:23:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:23:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:23:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:23:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:23:47 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3961ae8-ae5a-4615-b533-4b11eded762d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:23:47 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c1d132-d530-401e-8e8f-11080f3c8378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb] added
Oct 20 13:23:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a26a86-cc98-466b-a505-7f0c77371e68]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ecc909-8d48-41d0-899c-d1fa27b9560f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnOAWmML {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnOAWmML" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f13c7-244e-4813-b3d1-e76b54161130]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnOAWmML'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05ceaf-4808-4d00-af76-232d2ab3c3b6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9c011-7b06-4960-9f03-375a94eb2d35]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae213a4-68bf-4d44-bc3b-004a2e60e216]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260]
Oct 20 13:23:48 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260] successful.
Oct 20 13:23:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c817a9d-d581-4ca3-8f25-93629c8c46b1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84db4b-c64c-46cf-a6e2-4aa00c6d6247]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:23:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:23:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:23:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34cdfb4-fbfe-40fc-8a19-79a50e5ac48b]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:23:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23866636333336533', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866636333336533', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601830016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601830016',id=34,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-7tqht7zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:23:13Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=9dbb5296-c900-469d-8402-892639ec49ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:23:49 user nova-compute[74701]:   <uuid>9dbb5296-c900-469d-8402-892639ec49ea</uuid>
Oct 20 13:23:49 user nova-compute[74701]:   <name>instance-00000022</name>
Oct 20 13:23:49 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:23:49 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:23:49 user nova-compute[74701]:   <metadata>
Oct 20 13:23:49 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:23:49 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-601830016</nova:name>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:23:47</nova:creationTime>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:23:49 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:23:49 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:owner>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:23:49 user nova-compute[74701]:       </nova:owner>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:23:49 user nova-compute[74701]:       <nova:ports>
Oct 20 13:23:49 user nova-compute[74701]:         <nova:port uuid="ca30b384-8335-4b08-87c7-2b817067acb5">
Oct 20 13:23:49 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 13:23:49 user nova-compute[74701]:         </nova:port>
Oct 20 13:23:49 user nova-compute[74701]:       </nova:ports>
Oct 20 13:23:49 user nova-compute[74701]:     </nova:instance>
Oct 20 13:23:49 user nova-compute[74701]:   </metadata>
Oct 20 13:23:49 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:23:49 user nova-compute[74701]:     <system>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="serial">9dbb5296-c900-469d-8402-892639ec49ea</entry>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="uuid">9dbb5296-c900-469d-8402-892639ec49ea</entry>
Oct 20 13:23:49 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:23:49 user nova-compute[74701]:     </system>
Oct 20 13:23:49 user nova-compute[74701]:   </sysinfo>
Oct 20 13:23:49 user nova-compute[74701]:   <os>
Oct 20 13:23:49 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:23:49 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:23:49 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:23:49 user nova-compute[74701]:   </os>
Oct 20 13:23:49 user nova-compute[74701]:   <features>
Oct 20 13:23:49 user nova-compute[74701]:     <acpi/>
Oct 20 13:23:49 user nova-compute[74701]:     <apic/>
Oct 20 13:23:49 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:23:49 user nova-compute[74701]:   </features>
Oct 20 13:23:49 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:23:49 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:23:49 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:23:49 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:23:49 user nova-compute[74701]:   </clock>
Oct 20 13:23:49 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:23:49 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:23:49 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:23:49 user nova-compute[74701]:   </cpu>
Oct 20 13:23:49 user nova-compute[74701]:   <devices>
Oct 20 13:23:49 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:23:49 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:23:49 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:23:49 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:23:49 user nova-compute[74701]:       <serial>33b52204-24ee-48ef-ab1c-6b0c666dc7bb</serial>
Oct 20 13:23:49 user nova-compute[74701]:     </disk>
Oct 20 13:23:49 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:23:49 user nova-compute[74701]:       <mac address="fa:16:3e:af:da:e8"/>
Oct 20 13:23:49 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:23:49 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:23:49 user nova-compute[74701]:       <target dev="tapca30b384-83"/>
Oct 20 13:23:49 user nova-compute[74701]:     </interface>
Oct 20 13:23:49 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:23:49 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/console.log" append="off"/>
Oct 20 13:23:49 user nova-compute[74701]:     </serial>
Oct 20 13:23:49 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:23:49 user nova-compute[74701]:     <video>
Oct 20 13:23:49 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:23:49 user nova-compute[74701]:     </video>
Oct 20 13:23:49 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:23:49 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:23:49 user nova-compute[74701]:     </rng>
Oct 20 13:23:49 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:23:49 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:23:49 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:23:49 user nova-compute[74701]:     </memballoon>
Oct 20 13:23:49 user nova-compute[74701]:   </devices>
Oct 20 13:23:49 user nova-compute[74701]: </domain>
Oct 20 13:23:49 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601830016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601830016',id=34,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-7tqht7zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:23:13Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=9dbb5296-c900-469d-8402-892639ec49ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG os_vif [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b065da05-abf7-5259-b788-12da707d4326', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca30b384-83, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca30b384-83, col_values=(('qos', UUID('af00c426-82ae-43aa-aa35-f5550a54d020')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca30b384-83, col_values=(('external_ids', {'iface-id': 'ca30b384-8335-4b08-87c7-2b817067acb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:da:e8', 'vm-uuid': '9dbb5296-c900-469d-8402-892639ec49ea'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:49 user nova-compute[74701]: INFO os_vif [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83')
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:23:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:af:da:e8, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:23:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:51 user nova-compute[74701]: WARNING nova.compute.manager [req-875fa73e-e4bd-452e-85c2-154e19734a53 req-11563b1f-2773-4571-adf3-9bd0230547a7 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state building and task_state spawning.
Oct 20 13:23:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:23:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance spawned successfully.
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:23:53 user nova-compute[74701]: INFO nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:23:53 user nova-compute[74701]: INFO nova.compute.manager [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Took 40.73 seconds to build instance.
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:53 user nova-compute[74701]: WARNING nova.compute.manager [req-dfa269b7-7c9e-4bf2-b6aa-0a0f1b669ad5 req-491631bb-7142-42a7-9c7f-6b136fd67929 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state None.
Oct 20 13:23:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4bc165fb-038b-4fea-85d5-912abd203f21 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.852s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:57 user nova-compute[74701]: INFO nova.compute.manager [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Terminating instance
Oct 20 13:23:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-unplugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] No waiting events found dispatching network-vif-unplugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-c4b4a72e-c1a3-4fef-9602-08fb0b715295 req-a59edcb8-1495-4839-85dc-bd689d92c539 service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-unplugged-40610071-d339-41b5-af36-9b3f0ddee459 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:23:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Instance destroyed successfully.
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lazy-loading 'resources' on Instance uuid 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-447449680',display_name='tempest-TestServerVolumeAttachmentScenario-server-447449680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-447449680',id=30,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9DrA5PqbtWVc9rdMr/T1+ys6h5vjvqqFO9eK7MEY/Zefy/+7ELll/TimX2eRQqhoiNn4rl+XIi02PKOmLXLHnZSITEx1t01Lt7U+hn5jR7FEyaTKQxxjOT8/V5t20H3w==',key_name='tempest-keypair-542065987',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4c53bd7c9634c1fa382811dd0b74e69',ramdisk_id='',reservation_id='r-5siiw8j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1216667812',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1216667812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df429b97b49043ca8eb2428188581105',uuid=037ee17d-ff4e-42bb-8c8f-d29d4ed614f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converting VIF {"id": "40610071-d339-41b5-af36-9b3f0ddee459", "address": "fa:16:3e:f6:19:84", "network": {"id": "e765a9a7-99f4-41ce-8118-686d5078f0eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1195149608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c53bd7c9634c1fa382811dd0b74e69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40610071-d3", "ovs_interfaceid": "40610071-d339-41b5-af36-9b3f0ddee459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG os_vif [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40610071-d3, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c18f537-8538-478f-a835-e93428011336) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:23:58 user nova-compute[74701]: INFO os_vif [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:19:84,bridge_name='br-int',has_traffic_filtering=True,id=40610071-d339-41b5-af36-9b3f0ddee459,network=Network(e765a9a7-99f4-41ce-8118-686d5078f0eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40610071-d3')
Oct 20 13:23:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Deleting instance files /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4_del
Oct 20 13:23:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Deletion of /opt/stack/data/nova/instances/037ee17d-ff4e-42bb-8c8f-d29d4ed614f4_del complete
Oct 20 13:23:58 user nova-compute[74701]: INFO nova.compute.manager [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 13:23:58 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:23:58 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:23:59 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Took 1.28 seconds to deallocate network for instance.
Oct 20 13:23:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-42a1e888-864b-470a-8e36-420b9e606685 req-cafca9e8-6a11-4988-84ad-e30efbf9ba8d service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-deleted-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] Acquiring lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:23:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] No waiting events found dispatching network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:23:59 user nova-compute[74701]: WARNING nova.compute.manager [req-cae9e2a2-cafe-44e3-8db0-ebf87cedb825 req-b03dd134-94f6-426c-b123-aefcd151002d service nova] [instance: 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4] Received unexpected event network-vif-plugged-40610071-d339-41b5-af36-9b3f0ddee459 for instance with vm_state deleted and task_state None.
Oct 20 13:24:00 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:00 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:00 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Deleted allocations for instance 037ee17d-ff4e-42bb-8c8f-d29d4ed614f4
Oct 20 13:24:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-277f4655-4d7e-449d-b175-dfc567d79ced tempest-TestServerVolumeAttachmentScenario-1216667812 tempest-TestServerVolumeAttachmentScenario-1216667812-project-member] Lock "037ee17d-ff4e-42bb-8c8f-d29d4ed614f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.829s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:24:01 user nova-compute[74701]: INFO nova.compute.claims [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Claim successful on node user
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:24:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.policy [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52b23e0648e74a0ebdf77a03d4fe9483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81e60db14814ef8b68dda080fba920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:24:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Creating image(s)
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "/opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "/opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.228s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk 1073741824" returned: 0 in 0.056s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Cannot resize image /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Ensure instance console log exists: /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.011s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Successfully created port: 399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Successfully updated port: 399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquired lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received event network-changed-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Refreshing instance network info cache due to event network-changed-399f49a1-91b6-49e7-9105-a831a5b476f8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] Acquiring lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:24:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updating instance_info_cache with network_info: [{"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Releasing lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Instance network_info: |[{"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] Acquired lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Refreshing network info cache for port 399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Start _get_guest_xml network_info=[{"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:24:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:04 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-28556790',display_name='tempest-VolumesSnapshotTestJSON-instance-28556790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-28556790',id=35,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINhgALx1cfh4IH5eJOcWa3jRYD5E4vEJHwRReSdt/cdBA4G9EDZjx9ipmbzc8+qs819nqVrru7WELZD35cb6EZPuAHQ0M8bMXhDs7XhEhv/KBHSVBrJecV20TS3Ffy7Yg==',key_name='tempest-keypair-2017146645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-wl4hqazf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=a8760f22-731c-48ad-9c3b-253acfb402cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'pci_devices' on Instance uuid a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:24:04 user nova-compute[74701]:   <uuid>a8760f22-731c-48ad-9c3b-253acfb402cb</uuid>
Oct 20 13:24:04 user nova-compute[74701]:   <name>instance-00000023</name>
Oct 20 13:24:04 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:24:04 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:24:04 user nova-compute[74701]:   <metadata>
Oct 20 13:24:04 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:24:04 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-28556790</nova:name>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:24:04</nova:creationTime>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:24:04 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:24:04 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:owner>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:user uuid="52b23e0648e74a0ebdf77a03d4fe9483">tempest-VolumesSnapshotTestJSON-2076407407-project-member</nova:user>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:project uuid="f81e60db14814ef8b68dda080fba920e">tempest-VolumesSnapshotTestJSON-2076407407</nova:project>
Oct 20 13:24:04 user nova-compute[74701]:       </nova:owner>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:24:04 user nova-compute[74701]:       <nova:ports>
Oct 20 13:24:04 user nova-compute[74701]:         <nova:port uuid="399f49a1-91b6-49e7-9105-a831a5b476f8">
Oct 20 13:24:04 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 13:24:04 user nova-compute[74701]:         </nova:port>
Oct 20 13:24:04 user nova-compute[74701]:       </nova:ports>
Oct 20 13:24:04 user nova-compute[74701]:     </nova:instance>
Oct 20 13:24:04 user nova-compute[74701]:   </metadata>
Oct 20 13:24:04 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:24:04 user nova-compute[74701]:     <system>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="serial">a8760f22-731c-48ad-9c3b-253acfb402cb</entry>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="uuid">a8760f22-731c-48ad-9c3b-253acfb402cb</entry>
Oct 20 13:24:04 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:24:04 user nova-compute[74701]:     </system>
Oct 20 13:24:04 user nova-compute[74701]:   </sysinfo>
Oct 20 13:24:04 user nova-compute[74701]:   <os>
Oct 20 13:24:04 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:24:04 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:24:04 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:24:04 user nova-compute[74701]:   </os>
Oct 20 13:24:04 user nova-compute[74701]:   <features>
Oct 20 13:24:04 user nova-compute[74701]:     <acpi/>
Oct 20 13:24:04 user nova-compute[74701]:     <apic/>
Oct 20 13:24:04 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:24:04 user nova-compute[74701]:   </features>
Oct 20 13:24:04 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:24:04 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:24:04 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:24:04 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:24:04 user nova-compute[74701]:   </clock>
Oct 20 13:24:04 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:24:04 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:24:04 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:24:04 user nova-compute[74701]:   </cpu>
Oct 20 13:24:04 user nova-compute[74701]:   <devices>
Oct 20 13:24:04 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:24:04 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:24:04 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk"/>
Oct 20 13:24:04 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:24:04 user nova-compute[74701]:     </disk>
Oct 20 13:24:04 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:24:04 user nova-compute[74701]:       <mac address="fa:16:3e:d7:a1:06"/>
Oct 20 13:24:04 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:04 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:24:04 user nova-compute[74701]:       <target dev="tap399f49a1-91"/>
Oct 20 13:24:04 user nova-compute[74701]:     </interface>
Oct 20 13:24:04 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:24:04 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/console.log" append="off"/>
Oct 20 13:24:04 user nova-compute[74701]:     </serial>
Oct 20 13:24:04 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:24:04 user nova-compute[74701]:     <video>
Oct 20 13:24:04 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:04 user nova-compute[74701]:     </video>
Oct 20 13:24:04 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:24:04 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:24:04 user nova-compute[74701]:     </rng>
Oct 20 13:24:04 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:24:04 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:24:04 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:24:04 user nova-compute[74701]:     </memballoon>
Oct 20 13:24:04 user nova-compute[74701]:   </devices>
Oct 20 13:24:04 user nova-compute[74701]: </domain>
Oct 20 13:24:04 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-28556790',display_name='tempest-VolumesSnapshotTestJSON-instance-28556790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-28556790',id=35,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINhgALx1cfh4IH5eJOcWa3jRYD5E4vEJHwRReSdt/cdBA4G9EDZjx9ipmbzc8+qs819nqVrru7WELZD35cb6EZPuAHQ0M8bMXhDs7XhEhv/KBHSVBrJecV20TS3Ffy7Yg==',key_name='tempest-keypair-2017146645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-wl4hqazf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=a8760f22-731c-48ad-9c3b-253acfb402cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG os_vif [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d568021-d484-5d7f-af5c-a033d2fb18c8', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap399f49a1-91, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap399f49a1-91, col_values=(('qos', UUID('092eb62d-016b-4efb-94d5-020b71861fd5')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap399f49a1-91, col_values=(('external_ids', {'iface-id': '399f49a1-91b6-49e7-9105-a831a5b476f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a1:06', 'vm-uuid': 'a8760f22-731c-48ad-9c3b-253acfb402cb'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:04 user nova-compute[74701]: INFO os_vif [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91')
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No VIF found with MAC fa:16:3e:d7:a1:06, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updated VIF entry in instance network info cache for port 399f49a1-91b6-49e7-9105-a831a5b476f8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updating instance_info_cache with network_info: [{"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6e2baf28-0c73-4298-a195-8101b63bf157 req-47a3c5b5-b8b9-4f46-a6b4-f9625a7b4ff4 service nova] Releasing lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:24:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received event network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] No waiting events found dispatching network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:06 user nova-compute[74701]: WARNING nova.compute.manager [req-8ba3b102-84b9-4a2e-89e3-97dead7a70b0 req-7dab166e-f773-43cd-9fc7-4455346d8825 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received unexpected event network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 for instance with vm_state building and task_state spawning.
Oct 20 13:24:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8046MB free_disk=25.001117706298828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 372102fa-399b-4ae2-8c73-23b250e4d790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9dbb5296-c900-469d-8402-892639ec49ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a8760f22-731c-48ad-9c3b-253acfb402cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:24:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received event network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] No waiting events found dispatching network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:08 user nova-compute[74701]: WARNING nova.compute.manager [req-3684ff54-b05f-4b5f-a999-6823d8dd3b28 req-5bad8273-1b5b-4d5a-8efc-19ac41abb002 service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received unexpected event network-vif-plugged-399f49a1-91b6-49e7-9105-a831a5b476f8 for instance with vm_state building and task_state spawning.
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:24:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Instance spawned successfully.
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:08 user nova-compute[74701]: INFO nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Took 6.60 seconds to spawn the instance on the hypervisor.
Oct 20 13:24:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:24:08 user nova-compute[74701]: INFO nova.compute.manager [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Took 7.45 seconds to build instance.
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a3b86f5f-9f6e-4fe5-bcf9-df1d2842106b tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.556s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:11 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:24:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:18 user nova-compute[74701]: INFO nova.compute.manager [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Terminating instance
Oct 20 13:24:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-unplugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] No waiting events found dispatching network-vif-unplugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-bf8c90fd-ef3c-4bc2-873c-1be08d0fb604 req-1f7391c1-f892-499d-841e-715f6a8f6627 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-unplugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:24:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:24:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Instance destroyed successfully.
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.objects.instance [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'resources' on Instance uuid 372102fa-399b-4ae2-8c73-23b250e4d790 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1420456836',display_name='tempest-tempest.common.compute-instance-1420456836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1420456836',id=28,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXU6y6tFNGHTPacKZJCgIUu+ngKQu+rkfpzKy+M1MSHL+tA4yZj9LV7CJTyXaI1PGK/FK8cd10U+Bx+q3VgxGYsgBiM36QXuY9ApleSRHI/I3hOwYwy4S+EVbY2E8Gx+w==',key_name='tempest-keypair-754126478',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:18:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-dr6e0lv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=372102fa-399b-4ae2-8c73-23b250e4d790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "address": "fa:16:3e:65:42:34", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383ceab8-ce", "ovs_interfaceid": "383ceab8-ce75-4ada-8fff-ea65fbe8e7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG os_vif [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap383ceab8-ce, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3520eca-fc2e-4714-9fe0-54628dd9ffd9) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:19 user nova-compute[74701]: INFO os_vif [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:42:34,bridge_name='br-int',has_traffic_filtering=True,id=383ceab8-ce75-4ada-8fff-ea65fbe8e7ca,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383ceab8-ce')
Oct 20 13:24:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Deleting instance files /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790_del
Oct 20 13:24:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Deletion of /opt/stack/data/nova/instances/372102fa-399b-4ae2-8c73-23b250e4d790_del complete
Oct 20 13:24:19 user nova-compute[74701]: INFO nova.compute.manager [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 20 13:24:19 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:24:19 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:20 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Took 1.41 seconds to deallocate network for instance.
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] Acquiring lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] Lock "372102fa-399b-4ae2-8c73-23b250e4d790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] No waiting events found dispatching network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:20 user nova-compute[74701]: WARNING nova.compute.manager [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received unexpected event network-vif-plugged-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca for instance with vm_state deleted and task_state None.
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-a68199a6-40f0-48b3-823b-050e02175e07 req-e30eff71-602e-4062-be23-f57a87fceed4 service nova] [instance: 372102fa-399b-4ae2-8c73-23b250e4d790] Received event network-vif-deleted-383ceab8-ce75-4ada-8fff-ea65fbe8e7ca {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:21 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Deleted allocations for instance 372102fa-399b-4ae2-8c73-23b250e4d790
Oct 20 13:24:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-775643fe-52a2-4547-b99b-9a8816847a77 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "372102fa-399b-4ae2-8c73-23b250e4d790" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.015s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing instance network info cache due to event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:24:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] Acquiring lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] Acquired lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:27 user nova-compute[74701]: DEBUG nova.network.neutron [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:28 user nova-compute[74701]: INFO nova.compute.manager [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Attaching volume 09aeafd2-612f-46ac-94a8-f1e0039aa623 to /dev/vdb
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.utils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300dad9-c394-4272-b5ee-77b5d7d3b0be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49c87d-4460-46a4-bbc2-65be4c1ec7ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[92afd32f-2add-4664-8e44-1363f37363a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05783e29-4876-4511-a3ba-424055b7921f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:24:28 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d9c49-c123-4af6-bf5c-886259c4461c]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG os_brick.utils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating existing volume attachment record: 424652f3-cd48-4d2b-977e-7083114abe4b {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updated VIF entry in instance network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-751ebbd2-3990-4fc7-8107-4c11545cdcc3 req-7dcbdf6f-67dd-496b-97d3-93d692d4f3b1 service nova] Releasing lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:24:29 user nova-compute[74701]: INFO nova.compute.claims [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Claim successful on node user
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:24:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.policy [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3d2ceee53714d8692f2f91e305ac585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9286eb0e37747e5bddf389b90c0fd4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:24:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Creating image(s)
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "/opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "/opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.201s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.233s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk 1073741824" returned: 0 in 0.062s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Cannot resize image /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Ensure instance console log exists: /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Successfully created port: 183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Successfully updated port: 183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquired lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-changed-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Refreshing instance network info cache due to event network-changed-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] Acquiring lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Updating instance_info_cache with network_info: [{"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Releasing lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Instance network_info: |[{"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] Acquired lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.neutron [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Refreshing network info cache for port 183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Start _get_guest_xml network_info=[{"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:24:31 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:31 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2035862210',display_name='tempest-VolumesNegativeTest-instance-2035862210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2035862210',id=36,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9286eb0e37747e5bddf389b90c0fd4c',ramdisk_id='',reservation_id='r-1c8sp9jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1884091354',owner_user_name='tempest-VolumesNegativeTest-1884091354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:30Z,user_data=None,user_id='f3d2ceee53714d8692f2f91e305ac585',uuid=1ca8d46a-95cf-4521-a5db-e0d3d21294cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converting VIF {"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.objects.instance [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ca8d46a-95cf-4521-a5db-e0d3d21294cc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:31 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:24:31 user nova-compute[74701]:   <uuid>1ca8d46a-95cf-4521-a5db-e0d3d21294cc</uuid>
Oct 20 13:24:31 user nova-compute[74701]:   <name>instance-00000024</name>
Oct 20 13:24:31 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:24:31 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:24:31 user nova-compute[74701]:   <metadata>
Oct 20 13:24:31 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:24:31 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:name>tempest-VolumesNegativeTest-instance-2035862210</nova:name>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:24:31</nova:creationTime>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:24:31 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:24:31 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:owner>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:user uuid="f3d2ceee53714d8692f2f91e305ac585">tempest-VolumesNegativeTest-1884091354-project-member</nova:user>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:project uuid="c9286eb0e37747e5bddf389b90c0fd4c">tempest-VolumesNegativeTest-1884091354</nova:project>
Oct 20 13:24:31 user nova-compute[74701]:       </nova:owner>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:24:31 user nova-compute[74701]:       <nova:ports>
Oct 20 13:24:31 user nova-compute[74701]:         <nova:port uuid="183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772">
Oct 20 13:24:31 user nova-compute[74701]:           <nova:ip type="fixed" address="192.168.233.187" ipVersion="4"/>
Oct 20 13:24:31 user nova-compute[74701]:         </nova:port>
Oct 20 13:24:31 user nova-compute[74701]:       </nova:ports>
Oct 20 13:24:31 user nova-compute[74701]:     </nova:instance>
Oct 20 13:24:31 user nova-compute[74701]:   </metadata>
Oct 20 13:24:31 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:24:31 user nova-compute[74701]:     <system>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="serial">1ca8d46a-95cf-4521-a5db-e0d3d21294cc</entry>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="uuid">1ca8d46a-95cf-4521-a5db-e0d3d21294cc</entry>
Oct 20 13:24:31 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:24:31 user nova-compute[74701]:     </system>
Oct 20 13:24:31 user nova-compute[74701]:   </sysinfo>
Oct 20 13:24:31 user nova-compute[74701]:   <os>
Oct 20 13:24:31 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:24:31 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:24:31 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:24:31 user nova-compute[74701]:   </os>
Oct 20 13:24:31 user nova-compute[74701]:   <features>
Oct 20 13:24:31 user nova-compute[74701]:     <acpi/>
Oct 20 13:24:31 user nova-compute[74701]:     <apic/>
Oct 20 13:24:31 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:24:31 user nova-compute[74701]:   </features>
Oct 20 13:24:31 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:24:31 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:24:31 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:24:31 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:24:31 user nova-compute[74701]:   </clock>
Oct 20 13:24:31 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:24:31 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:24:31 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:24:31 user nova-compute[74701]:   </cpu>
Oct 20 13:24:31 user nova-compute[74701]:   <devices>
Oct 20 13:24:31 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:24:31 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:24:31 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk"/>
Oct 20 13:24:31 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:24:31 user nova-compute[74701]:     </disk>
Oct 20 13:24:31 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:24:31 user nova-compute[74701]:       <mac address="fa:16:3e:18:30:df"/>
Oct 20 13:24:31 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:31 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:24:31 user nova-compute[74701]:       <target dev="tap183f7a8f-d9"/>
Oct 20 13:24:31 user nova-compute[74701]:     </interface>
Oct 20 13:24:31 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:24:31 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/console.log" append="off"/>
Oct 20 13:24:31 user nova-compute[74701]:     </serial>
Oct 20 13:24:31 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:24:31 user nova-compute[74701]:     <video>
Oct 20 13:24:31 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:31 user nova-compute[74701]:     </video>
Oct 20 13:24:31 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:24:31 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:24:31 user nova-compute[74701]:     </rng>
Oct 20 13:24:31 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:24:31 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:24:31 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:24:31 user nova-compute[74701]:     </memballoon>
Oct 20 13:24:31 user nova-compute[74701]:   </devices>
Oct 20 13:24:31 user nova-compute[74701]: </domain>
Oct 20 13:24:31 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2035862210',display_name='tempest-VolumesNegativeTest-instance-2035862210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2035862210',id=36,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9286eb0e37747e5bddf389b90c0fd4c',ramdisk_id='',reservation_id='r-1c8sp9jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1884091354',owner_user_name='tempest-VolumesNegativeTest-1884091354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:30Z,user_data=None,user_id='f3d2ceee53714d8692f2f91e305ac585',uuid=1ca8d46a-95cf-4521-a5db-e0d3d21294cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converting VIF {"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG os_vif [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bde6bb9e-4aa6-549c-af10-7d468117a2ed', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183f7a8f-d9, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap183f7a8f-d9, col_values=(('qos', UUID('74f72c76-ad25-43f4-98e9-634677113503')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap183f7a8f-d9, col_values=(('external_ids', {'iface-id': '183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:30:df', 'vm-uuid': '1ca8d46a-95cf-4521-a5db-e0d3d21294cc'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:32 user nova-compute[74701]: INFO os_vif [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9')
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] No VIF found with MAC fa:16:3e:18:30:df, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Updated VIF entry in instance network info cache for port 183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Updating instance_info_cache with network_info: [{"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6ce8f436-9ab2-41bf-8669-a5744bc2d9b9 req-8b7360e0-6be4-4377-9dd0-e0ff0d5c9529 service nova] Releasing lock "refresh_cache-1ca8d46a-95cf-4521-a5db-e0d3d21294cc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] No waiting events found dispatching network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:34 user nova-compute[74701]: WARNING nova.compute.manager [req-3816f5ea-aeab-427a-9499-a8e78e7a667a req-2590f996-1725-4ac6-9741-3dc888eee4ee service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received unexpected event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 for instance with vm_state building and task_state spawning.
Oct 20 13:24:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:24:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Instance spawned successfully.
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:35 user nova-compute[74701]: INFO nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Took 6.00 seconds to spawn the instance on the hypervisor.
Oct 20 13:24:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:24:35 user nova-compute[74701]: INFO nova.compute.manager [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Took 6.81 seconds to build instance.
Oct 20 13:24:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-28f9ea26-8d43-49ef-bdb8-dd3e2a1aa5ec tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.935s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] No waiting events found dispatching network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:36 user nova-compute[74701]: WARNING nova.compute.manager [req-bc5510ba-2001-4ff3-99e4-ab5a148e73fb req-b41daeac-2ef6-42e5-b933-f5b08937d2df service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received unexpected event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 for instance with vm_state active and task_state None.
Oct 20 13:24:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:24:39 user nova-compute[74701]: INFO nova.compute.claims [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Claim successful on node user
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:24:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:24:39 user nova-compute[74701]: DEBUG nova.policy [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '037a86ef21bf4b58874c1ce851f51ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eef02ee91884642a3c6612d54890923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:24:40 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Creating image(s)
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk 1073741824" returned: 0 in 0.060s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Successfully created port: 7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Cannot resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Ensure instance console log exists: /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Successfully updated port: 7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-changed-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Refreshing instance network info cache due to event network-changed-7bc61d81-aed3-4a1d-8243-1affa2da3280. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.neutron [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance network_info: |[{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Refreshing network info cache for port 7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start _get_guest_xml network_info=[{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:24:41 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:41 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:41 user nova-compute[74701]: DEBUG nova.objects.instance [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:24:42 user nova-compute[74701]:   <uuid>8e32bfa5-4d85-409b-95f7-05f8bab18414</uuid>
Oct 20 13:24:42 user nova-compute[74701]:   <name>instance-00000025</name>
Oct 20 13:24:42 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:24:42 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:24:42 user nova-compute[74701]:   <metadata>
Oct 20 13:24:42 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:24:42 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeTestJSON-server-1501582274</nova:name>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:24:41</nova:creationTime>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:24:42 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:24:42 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:owner>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:user uuid="037a86ef21bf4b58874c1ce851f51ae6">tempest-AttachVolumeTestJSON-117323651-project-member</nova:user>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:project uuid="2eef02ee91884642a3c6612d54890923">tempest-AttachVolumeTestJSON-117323651</nova:project>
Oct 20 13:24:42 user nova-compute[74701]:       </nova:owner>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:24:42 user nova-compute[74701]:       <nova:ports>
Oct 20 13:24:42 user nova-compute[74701]:         <nova:port uuid="7bc61d81-aed3-4a1d-8243-1affa2da3280">
Oct 20 13:24:42 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:24:42 user nova-compute[74701]:         </nova:port>
Oct 20 13:24:42 user nova-compute[74701]:       </nova:ports>
Oct 20 13:24:42 user nova-compute[74701]:     </nova:instance>
Oct 20 13:24:42 user nova-compute[74701]:   </metadata>
Oct 20 13:24:42 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:24:42 user nova-compute[74701]:     <system>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="serial">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="uuid">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:24:42 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:24:42 user nova-compute[74701]:     </system>
Oct 20 13:24:42 user nova-compute[74701]:   </sysinfo>
Oct 20 13:24:42 user nova-compute[74701]:   <os>
Oct 20 13:24:42 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:24:42 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:24:42 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:24:42 user nova-compute[74701]:   </os>
Oct 20 13:24:42 user nova-compute[74701]:   <features>
Oct 20 13:24:42 user nova-compute[74701]:     <acpi/>
Oct 20 13:24:42 user nova-compute[74701]:     <apic/>
Oct 20 13:24:42 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:24:42 user nova-compute[74701]:   </features>
Oct 20 13:24:42 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:24:42 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:24:42 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:24:42 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:24:42 user nova-compute[74701]:   </clock>
Oct 20 13:24:42 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:24:42 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:24:42 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:24:42 user nova-compute[74701]:   </cpu>
Oct 20 13:24:42 user nova-compute[74701]:   <devices>
Oct 20 13:24:42 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:24:42 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:24:42 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk"/>
Oct 20 13:24:42 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:24:42 user nova-compute[74701]:     </disk>
Oct 20 13:24:42 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:24:42 user nova-compute[74701]:       <mac address="fa:16:3e:f5:d0:67"/>
Oct 20 13:24:42 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:42 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:24:42 user nova-compute[74701]:       <target dev="tap7bc61d81-ae"/>
Oct 20 13:24:42 user nova-compute[74701]:     </interface>
Oct 20 13:24:42 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:24:42 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/console.log" append="off"/>
Oct 20 13:24:42 user nova-compute[74701]:     </serial>
Oct 20 13:24:42 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:24:42 user nova-compute[74701]:     <video>
Oct 20 13:24:42 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:24:42 user nova-compute[74701]:     </video>
Oct 20 13:24:42 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:24:42 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:24:42 user nova-compute[74701]:     </rng>
Oct 20 13:24:42 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:24:42 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:24:42 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:24:42 user nova-compute[74701]:     </memballoon>
Oct 20 13:24:42 user nova-compute[74701]:   </devices>
Oct 20 13:24:42 user nova-compute[74701]: </domain>
Oct 20 13:24:42 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG os_vif [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b05c3f81-abb8-524b-bdef-d0af116c90a2', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc61d81-ae, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bc61d81-ae, col_values=(('qos', UUID('14ccccde-2c16-4031-8075-0c8807d437a4')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bc61d81-ae, col_values=(('external_ids', {'iface-id': '7bc61d81-aed3-4a1d-8243-1affa2da3280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d0:67', 'vm-uuid': '8e32bfa5-4d85-409b-95f7-05f8bab18414'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:42 user nova-compute[74701]: INFO os_vif [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No VIF found with MAC fa:16:3e:f5:d0:67, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.network.neutron [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updated VIF entry in instance network info cache for port 7bc61d81-aed3-4a1d-8243-1affa2da3280. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG nova.network.neutron [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:24:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-fd1bef97-ab77-454b-947f-351050bb0348 req-e5459762-f10e-454c-8d78-fcde1f3d97b6 service nova] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:43 user nova-compute[74701]: WARNING nova.compute.manager [req-0e1e0ca8-51c2-486c-ae4e-643fae190e9c req-70fb9aa5-02de-41fe-a36f-4b076b7e0605 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state building and task_state spawning.
Oct 20 13:24:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:24:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance spawned successfully.
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:24:45 user nova-compute[74701]: WARNING nova.compute.manager [req-049eb495-589a-4c7e-a528-c41edd90e906 req-a817c6b2-f4a0-49b4-9831-d94e9bf92b08 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state building and task_state spawning.
Oct 20 13:24:45 user nova-compute[74701]: INFO nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 20 13:24:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:24:46 user nova-compute[74701]: INFO nova.compute.manager [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Took 6.79 seconds to build instance.
Oct 20 13:24:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-281cff72-cf16-4a37-8bcd-c76e3002d43d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYwJfdTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:24:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:24:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:24:47 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4db46f-3f7c-424d-bbfc-3ee7d6875d54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:24:47 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[20528add-6ba5-4fb8-adf6-35dd071dca29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623] added
Oct 20 13:24:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b0dec-5c41-4199-ad6b-bf015a7830b1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd8fc19-5bea-4458-bf3c-6fdcd32ec88d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYwJfdTR {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYwJfdTR" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3503b-0e4e-45ea-92b2-6cc28399aec3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYwJfdTR'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c11b779-86da-427e-a555-7766b9d4c6b5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ef596-540b-4fd9-82c7-d477064a2cf4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:24:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:24:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50e0c4-5b1b-4fa2-aed5-41fbb1a4fa55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260]
Oct 20 13:24:48 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260] successful.
Oct 20 13:24:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[283bae9c-5b58-4cf7-a8fa-34280f10d6c0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7772e3-7a47-45aa-be47-d66cea6820b3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:24:48 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:24:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3289341-cf7b-41bd-b0cf-c5d208ae744f]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:24:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYwJfdTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26535313132323561', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535313132323561', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:24:49 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:24:49 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:24:49 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:24:49 user nova-compute[74701]:   <serial>09aeafd2-612f-46ac-94a8-f1e0039aa623</serial>
Oct 20 13:24:49 user nova-compute[74701]: </disk>
Oct 20 13:24:49 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:24:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No VIF found with MAC fa:16:3e:fa:f9:0c, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:24:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0fdb092b-1cfd-44be-90a8-42fd94771374 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.775s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:24:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:24:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:24:52 user nova-compute[74701]: INFO nova.compute.manager [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Detaching volume 09aeafd2-612f-46ac-94a8-f1e0039aa623
Oct 20 13:24:52 user nova-compute[74701]: INFO nova.virt.block_device [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Attempting to driver detach volume 09aeafd2-612f-46ac-94a8-f1e0039aa623 from mountpoint /dev/vdb
Oct 20 13:24:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Attempting to detach device vdb from instance f5fa149e-2c53-42c6-8582-8dc13ea18857 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:24:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:24:52 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:24:52 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:24:52 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:24:52 user nova-compute[74701]:   <serial>09aeafd2-612f-46ac-94a8-f1e0039aa623</serial>
Oct 20 13:24:52 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:24:52 user nova-compute[74701]: </disk>
Oct 20 13:24:52 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:24:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully detached device vdb from instance f5fa149e-2c53-42c6-8582-8dc13ea18857 from the persistent domain config.
Oct 20 13:24:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5fa149e-2c53-42c6-8582-8dc13ea18857 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:24:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:24:52 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:24:52 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:24:52 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:24:52 user nova-compute[74701]:   <serial>09aeafd2-612f-46ac-94a8-f1e0039aa623</serial>
Oct 20 13:24:52 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:24:52 user nova-compute[74701]: </disk>
Oct 20 13:24:52 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:24:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:24:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:24:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:03 user nova-compute[74701]: INFO nova.compute.manager [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Rescuing
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:25:03 user nova-compute[74701]: DEBUG nova.network.neutron [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating instance_info_cache with network_info: [{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:04 user nova-compute[74701]: WARNING nova.compute.manager [req-6af648d8-a6e6-4420-ae1c-00cd0ed2d837 req-30804763-ddc8-4c26-93e0-46f960b74d2e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state rescuing.
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:04 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance destroyed successfully.
Oct 20 13:25:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Attempting a stable device rescue
Oct 20 13:25:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74701) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:25:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Creating image(s)
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "71d991d9272332c833115f1bec112185408c2926" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "71d991d9272332c833115f1bec112185408c2926" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:25:05 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 1.101s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG nova.virt.images [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] 82d3d6c3-50dc-4db0-a8b6-0647b6692ad4 was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.part /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:06 user nova-compute[74701]: WARNING nova.compute.manager [req-1a42c559-01a0-4e06-9184-2d7d88a308ca req-b150e641-5e42-4c05-a7c5-9ca9b9b45a43 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state rescuing.
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.part /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.converted" returned: 0 in 0.550s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.384s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "71d991d9272332c833115f1bec112185408c2926" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.060s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "71d991d9272332c833115f1bec112185408c2926" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "71d991d9272332c833115f1bec112185408c2926" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926 --force-share --output=json" returned: 0 in 0.168s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926,backing_fmt=raw /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926,backing_fmt=raw /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue" returned: 0 in 0.052s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "71d991d9272332c833115f1bec112185408c2926" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'migration_context' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<9dbb5296-c900-469d-8402-892639ec49ea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start _get_guest_xml network_info=[{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:af:da:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '82d3d6c3-50dc-4db0-a8b6-0647b6692ad4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9dbb5296-c900-469d-8402-892639ec49ea', 'attached_at': '', 'detached_at': '', 'volume_id': '33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'serial': '33b52204-24ee-48ef-ab1c-6b0c666dc7bb'}, 'attachment_id': 'ea88a0e4-2452-4675-88a2-61a1bde7a2df', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<9dbb5296-c900-469d-8402-892639ec49ea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'numa_topology' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<9dbb5296-c900-469d-8402-892639ec49ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:07 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<9dbb5296-c900-469d-8402-892639ec49ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:25:07 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:25:07 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:25:07 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b17036f-1b4e-4a83-97a3-72360f6bbdfd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dnOAWmML\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 13:25:07 user nova-compute[74701]: node.name = iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb
Oct 20 13:25:07 user nova-compute[74701]: node.tpgt = -1
Oct 20 13:25:07 user nova-compute[74701]: node.startup = automatic
Oct 20 13:25:07 user nova-compute[74701]: node.leading_login = No
Oct 20 13:25:07 user nova-compute[74701]: iface.iscsi_ifacename = default
Oct 20 13:25:07 user nova-compute[74701]: iface.net_ifacename = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.ipaddress = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.prefix_len = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.hwaddress = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.transport_name = tcp
Oct 20 13:25:07 user nova-compute[74701]: iface.initiatorname = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.vlan_id = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.vlan_priority = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.vlan_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.iface_num = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.mtu = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.port = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.bootproto = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.subnet_mask = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.gateway = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_alt_client_id = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_dns = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_learn_iqn = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_vendor_id_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_vendor_id = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.dhcp_slp_da = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.fragmentation = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.gratuitous_arp = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.incoming_forwarding = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.tos_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.tos = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.ttl = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.delayed_ack = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.tcp_nagle = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.tcp_wsf_state = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.tcp_wsf = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.tcp_timer_scale = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.tcp_timestamp = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.redirect = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.def_task_mgmt_timeout = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.header_digest = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.data_digest = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.immediate_data = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.initial_r2t = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.data_seq_inorder = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.data_pdu_inorder = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.erl = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.max_receive_data_len = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.first_burst_len = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.max_outstanding_r2t = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.max_burst_len = 0
Oct 20 13:25:07 user nova-compute[74701]: iface.chap_auth = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.bidi_chap = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.strict_login_compliance = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.discovery_auth = <empty>
Oct 20 13:25:07 user nova-compute[74701]: iface.discovery_logout = <empty>
Oct 20 13:25:07 user nova-compute[74701]: node.discovery_address = <empty>
Oct 20 13:25:07 user nova-compute[74701]: node.discovery_port = 0
Oct 20 13:25:07 user nova-compute[74701]: node.discovery_type = static
Oct 20 13:25:07 user nova-compute[74701]: node.session.initial_cmdsn = 0
Oct 20 13:25:07 user nova-compute[74701]: node.session.initial_login_retry_max = 8
Oct 20 13:25:07 user nova-compute[74701]: node.session.xmit_thread_priority = -20
Oct 20 13:25:07 user nova-compute[74701]: node.session.cmds_max = 128
Oct 20 13:25:07 user nova-compute[74701]: node.session.queue_depth = 32
Oct 20 13:25:07 user nova-compute[74701]: node.session.nr_sessions = 1
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.authmethod = CHAP
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.username = dnOAWmML
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.password = ***
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.username_in = <empty>
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.password_in = <empty>
Oct 20 13:25:07 user nova-compute[74701]: node.session.auth.chap_algs = MD5
Oct 20 13:25:07 user nova-compute[74701]: node.session.timeo.replacement_timeout = 120
Oct 20 13:25:07 user nova-compute[74701]: node.session.err_timeo.abort_timeout = 15
Oct 20 13:25:07 user nova-compute[74701]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 13:25:07 user nova-compute[74701]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 13:25:07 user nova-compute[74701]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.FastAbort = Yes
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.InitialR2T = No
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.ImmediateData = Yes
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.MaxConnections = 1
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 13:25:07 user nova-compute[74701]: node.session.iscsi.ERL = 0
Oct 20 13:25:07 user nova-compute[74701]: node.session.scan = manual
Oct 20 13:25:07 user nova-compute[74701]: node.session.reopen_max = 0
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].address = 172.16.0.220
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].port = 3260
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].startup = manual
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].tcp.window_size = 524288
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].tcp.type_of_service = 0
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].timeo.logout_timeout = 15
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].timeo.login_timeout = 15
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].timeo.auth_timeout = 45
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.DataDigest = None
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.IFMarker = No
Oct 20 13:25:07 user nova-compute[74701]: node.conn[0].iscsi.OFMarker = No
Oct 20 13:25:07 user nova-compute[74701]: # END RECORD
Oct 20 13:25:07 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1058c4-344d-42e4-9288-680baa0456c1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[275196c6-68c7-4d4b-a737-66c632c33d0f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnOAWmML {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnOAWmML" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c192a-d24c-4b5b-9309-f799f19d885a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnOAWmML'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[359578e2-a8a7-40fe-938c-cf0f333940c6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69116cab-1a30-4ebe-81b6-f02c6f2d9a4e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:25:07 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:25:07 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:25:07 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:25:07 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:25:07 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:25:07 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.207s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb4c53-1f8b-4ef9-8b38-fa75f2b897b5]: (4, ('0 0 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.240s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== connect_volume: return (241ms) {'type': 'block', 'scsi_wwn': '23866636333336533', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866636333336533', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601830016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601830016',id=34,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:23:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-7tqht7zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:23:53Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=9dbb5296-c900-469d-8402-892639ec49ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:af:da:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "vif_mac": "fa:16:3e:af:da:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Object Instance<9dbb5296-c900-469d-8402-892639ec49ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:25:07 user nova-compute[74701]:   <uuid>9dbb5296-c900-469d-8402-892639ec49ea</uuid>
Oct 20 13:25:07 user nova-compute[74701]:   <name>instance-00000022</name>
Oct 20 13:25:07 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:25:07 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:25:07 user nova-compute[74701]:   <metadata>
Oct 20 13:25:07 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:25:07 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-601830016</nova:name>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:25:07</nova:creationTime>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:25:07 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:25:07 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:owner>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:user uuid="751a8755f9774b1da2e71623164c40b9">tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member</nova:user>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:project uuid="1ed52bceb45147ceb782e49acf3a9d39">tempest-ServerBootFromVolumeStableRescueTest-1693514684</nova:project>
Oct 20 13:25:07 user nova-compute[74701]:       </nova:owner>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:25:07 user nova-compute[74701]:       <nova:ports>
Oct 20 13:25:07 user nova-compute[74701]:         <nova:port uuid="ca30b384-8335-4b08-87c7-2b817067acb5">
Oct 20 13:25:07 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 13:25:07 user nova-compute[74701]:         </nova:port>
Oct 20 13:25:07 user nova-compute[74701]:       </nova:ports>
Oct 20 13:25:07 user nova-compute[74701]:     </nova:instance>
Oct 20 13:25:07 user nova-compute[74701]:   </metadata>
Oct 20 13:25:07 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:25:07 user nova-compute[74701]:     <system>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="serial">9dbb5296-c900-469d-8402-892639ec49ea</entry>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="uuid">9dbb5296-c900-469d-8402-892639ec49ea</entry>
Oct 20 13:25:07 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:25:07 user nova-compute[74701]:     </system>
Oct 20 13:25:07 user nova-compute[74701]:   </sysinfo>
Oct 20 13:25:07 user nova-compute[74701]:   <os>
Oct 20 13:25:07 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:25:07 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:25:07 user nova-compute[74701]:   </os>
Oct 20 13:25:07 user nova-compute[74701]:   <features>
Oct 20 13:25:07 user nova-compute[74701]:     <acpi/>
Oct 20 13:25:07 user nova-compute[74701]:     <apic/>
Oct 20 13:25:07 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:25:07 user nova-compute[74701]:   </features>
Oct 20 13:25:07 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:25:07 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:25:07 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:25:07 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:25:07 user nova-compute[74701]:   </clock>
Oct 20 13:25:07 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:25:07 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:25:07 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:25:07 user nova-compute[74701]:   </cpu>
Oct 20 13:25:07 user nova-compute[74701]:   <devices>
Oct 20 13:25:07 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:25:07 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:25:07 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:25:07 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:25:07 user nova-compute[74701]:       <serial>33b52204-24ee-48ef-ab1c-6b0c666dc7bb</serial>
Oct 20 13:25:07 user nova-compute[74701]:     </disk>
Oct 20 13:25:07 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:25:07 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:25:07 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue"/>
Oct 20 13:25:07 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:25:07 user nova-compute[74701]:       <boot order="1"/>
Oct 20 13:25:07 user nova-compute[74701]:     </disk>
Oct 20 13:25:07 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:25:07 user nova-compute[74701]:       <mac address="fa:16:3e:af:da:e8"/>
Oct 20 13:25:07 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:25:07 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:25:07 user nova-compute[74701]:       <target dev="tapca30b384-83"/>
Oct 20 13:25:07 user nova-compute[74701]:     </interface>
Oct 20 13:25:07 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:25:07 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/console.log" append="off"/>
Oct 20 13:25:07 user nova-compute[74701]:     </serial>
Oct 20 13:25:07 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:25:07 user nova-compute[74701]:     <video>
Oct 20 13:25:07 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:25:07 user nova-compute[74701]:     </video>
Oct 20 13:25:07 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:25:07 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:25:07 user nova-compute[74701]:     </rng>
Oct 20 13:25:07 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:25:07 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:25:07 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:25:07 user nova-compute[74701]:     </memballoon>
Oct 20 13:25:07 user nova-compute[74701]:   </devices>
Oct 20 13:25:07 user nova-compute[74701]: </domain>
Oct 20 13:25:07 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:25:07 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance destroyed successfully.
Oct 20 13:25:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:25:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:25:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] No VIF found with MAC fa:16:3e:af:da:e8, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:25:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c0bf5654-6283-4da2-b065-a8b3642b6a4b tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:12 user nova-compute[74701]: WARNING nova.compute.manager [req-3df02511-c724-4fa6-b35a-9baaf3132d6e req-2e419881-7717-4a78-8c99-1ca1e5506b9c service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state rescuing.
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:12 user nova-compute[74701]: WARNING nova.compute.manager [req-576558fa-7d1b-498e-a6b9-b8d0c8458650 req-d3be2299-1b41-4485-ad42-24ebc4f23625 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state rescuing.
Oct 20 13:25:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=24.917644500732422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:12 user nova-compute[74701]: INFO nova.compute.manager [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Unshelving
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9dbb5296-c900-469d-8402-892639ec49ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a8760f22-731c-48ad-9c3b-253acfb402cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1ca8d46a-95cf-4521-a5db-e0d3d21294cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.416s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_requests' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:25:12 user nova-compute[74701]: INFO nova.compute.claims [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Claim successful on node user
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:13 user nova-compute[74701]: INFO nova.network.neutron [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating port 3753e7a7-d8ec-4e83-a888-19793f0d839a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 13:25:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5fa149e-2c53-42c6-8582-8dc13ea18857 is timed out.
Oct 20 13:25:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully detached device vdb from instance f5fa149e-2c53-42c6-8582-8dc13ea18857 from the live domain config.
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYwJfdTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:25:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec03493-5c89-40df-8f42-6f37faa66a66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:25:13 user nova-compute[74701]: No targets found.
Oct 20 13:25:13 user nova-compute[74701]: iSNS:
Oct 20 13:25:13 user nova-compute[74701]: No targets found.
Oct 20 13:25:13 user nova-compute[74701]: STATIC:
Oct 20 13:25:13 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:25:13 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:25:13 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:25:13 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb
Oct 20 13:25:13 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:25:13 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:25:13 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623
Oct 20 13:25:13 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:25:13 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:25:13 user nova-compute[74701]: FIRMWARE:
Oct 20 13:25:13 user nova-compute[74701]: No targets found.
Oct 20 13:25:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:25:13 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:25:13 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9043c23-a55e-4d96-8374-f16e33011c7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[08218acd-b514-4b28-9edf-9a571dc031c4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:25:13 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:25:13 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:25:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:25:13 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:25:13 user nova-compute[74701]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 (non-flash)
Oct 20 13:25:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc7ab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c811ebd9-e2ae-4ba5-a50a-66a35d4da4ab]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043ee0b-f85c-4914-9ae2-228e64a47984]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3c89f-c3f4-40a3-ad6f-1c1bce1f4afd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42574056-d40c-4268-bb4a-de01d0bb5722]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf7ada2-c00a-47eb-93bf-66d40fb4de5f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4def41-a6e9-444c-aa4e-1ce401411363]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260]
Oct 20 13:25:13 user nova-compute[74701]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623, portal: 172.16.0.220,3260] successful.
Oct 20 13:25:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09aeafd2-612f-46ac-94a8-f1e0039aa623 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2269a8-264b-4a9a-9c59-dd72eb8df8ed]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== disconnect_volume: return (343ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:25:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing instance network info cache due to event network-changed-3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] Acquiring lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-45c168bc-5435-41c4-bc73-a5cdbf0628f2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:25:15 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Creating image(s)
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] Acquired lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Refreshing network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG nova.objects.base [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<8fc7fb59-af87-4358-a67f-1f2d6abb9a56> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG nova.virt.images [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] 57dd95cf-8ed8-45b5-9325-3a125a901fb6 was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.part /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG nova.network.neutron [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updated VIF entry in instance network info cache for port 3753e7a7-d8ec-4e83-a888-19793f0d839a. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG nova.network.neutron [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15b8a674-a713-4b4c-9780-ad8b83d519b9 req-93e0c769-b171-4a31-b4a3-780c9f821a79 service nova] Releasing lock "refresh_cache-8fc7fb59-af87-4358-a67f-1f2d6abb9a56" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.part /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.converted" returned: 0 in 0.477s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.913s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c,backing_fmt=raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c,backing_fmt=raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk 1073741824" returned: 0 in 0.048s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "984b3f0a3f4c41fb0ce577af0573eff5a33d543c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'migration_context' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG nova.objects.base [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<8fc7fb59-af87-4358-a67f-1f2d6abb9a56> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Rebasing disk image.
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b -F raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b -F raw /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk" returned: 0 in 2.275s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Ensure instance console log exists: /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start _get_guest_xml network_info=[{"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e634f0cff11da2ba897bb71991d0d7d5',container_format='bare',created_at=2023-10-20T13:23:16Z,direct_url=<?>,disk_format='qcow2',id=57dd95cf-8ed8-45b5-9325-3a125a901fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-245423320-shelved',owner='eaf15939da12479f9c7bfff1c4198efe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:23:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:25:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e634f0cff11da2ba897bb71991d0d7d5',container_format='bare',created_at=2023-10-20T13:23:16Z,direct_url=<?>,disk_format='qcow2',id=57dd95cf-8ed8-45b5-9325-3a125a901fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-245423320-shelved',owner='eaf15939da12479f9c7bfff1c4198efe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:23:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:20 user nova-compute[74701]: DEBUG nova.objects.base [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<8fc7fb59-af87-4358-a67f-1f2d6abb9a56> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='57dd95cf-8ed8-45b5-9325-3a125a901fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-194972029',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:23:21.355168',shelved_host='user',shelved_image_id='57dd95cf-8ed8-45b5-9325-3a125a901fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.objects.base [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Object Instance<8fc7fb59-af87-4358-a67f-1f2d6abb9a56> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:25:21 user nova-compute[74701]:   <uuid>8fc7fb59-af87-4358-a67f-1f2d6abb9a56</uuid>
Oct 20 13:25:21 user nova-compute[74701]:   <name>instance-00000020</name>
Oct 20 13:25:21 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:25:21 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:25:21 user nova-compute[74701]:   <metadata>
Oct 20 13:25:21 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:25:21 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-245423320</nova:name>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:25:20</nova:creationTime>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:25:21 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:25:21 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:owner>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:user uuid="22371d97e6c1416499916660b5b2b07e">tempest-AttachVolumeShelveTestJSON-1805146529-project-member</nova:user>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:project uuid="eaf15939da12479f9c7bfff1c4198efe">tempest-AttachVolumeShelveTestJSON-1805146529</nova:project>
Oct 20 13:25:21 user nova-compute[74701]:       </nova:owner>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:root type="image" uuid="57dd95cf-8ed8-45b5-9325-3a125a901fb6"/>
Oct 20 13:25:21 user nova-compute[74701]:       <nova:ports>
Oct 20 13:25:21 user nova-compute[74701]:         <nova:port uuid="3753e7a7-d8ec-4e83-a888-19793f0d839a">
Oct 20 13:25:21 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:25:21 user nova-compute[74701]:         </nova:port>
Oct 20 13:25:21 user nova-compute[74701]:       </nova:ports>
Oct 20 13:25:21 user nova-compute[74701]:     </nova:instance>
Oct 20 13:25:21 user nova-compute[74701]:   </metadata>
Oct 20 13:25:21 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:25:21 user nova-compute[74701]:     <system>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="serial">8fc7fb59-af87-4358-a67f-1f2d6abb9a56</entry>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="uuid">8fc7fb59-af87-4358-a67f-1f2d6abb9a56</entry>
Oct 20 13:25:21 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:25:21 user nova-compute[74701]:     </system>
Oct 20 13:25:21 user nova-compute[74701]:   </sysinfo>
Oct 20 13:25:21 user nova-compute[74701]:   <os>
Oct 20 13:25:21 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:25:21 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:25:21 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:25:21 user nova-compute[74701]:   </os>
Oct 20 13:25:21 user nova-compute[74701]:   <features>
Oct 20 13:25:21 user nova-compute[74701]:     <acpi/>
Oct 20 13:25:21 user nova-compute[74701]:     <apic/>
Oct 20 13:25:21 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:25:21 user nova-compute[74701]:   </features>
Oct 20 13:25:21 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:25:21 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:25:21 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:25:21 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:25:21 user nova-compute[74701]:   </clock>
Oct 20 13:25:21 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:25:21 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:25:21 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:25:21 user nova-compute[74701]:   </cpu>
Oct 20 13:25:21 user nova-compute[74701]:   <devices>
Oct 20 13:25:21 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:25:21 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:25:21 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk"/>
Oct 20 13:25:21 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:25:21 user nova-compute[74701]:     </disk>
Oct 20 13:25:21 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:25:21 user nova-compute[74701]:       <mac address="fa:16:3e:d2:54:76"/>
Oct 20 13:25:21 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:25:21 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:25:21 user nova-compute[74701]:       <target dev="tap3753e7a7-d8"/>
Oct 20 13:25:21 user nova-compute[74701]:     </interface>
Oct 20 13:25:21 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:25:21 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/console.log" append="off"/>
Oct 20 13:25:21 user nova-compute[74701]:     </serial>
Oct 20 13:25:21 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:25:21 user nova-compute[74701]:     <video>
Oct 20 13:25:21 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:25:21 user nova-compute[74701]:     </video>
Oct 20 13:25:21 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:25:21 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:25:21 user nova-compute[74701]:     </rng>
Oct 20 13:25:21 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:25:21 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:25:21 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:25:21 user nova-compute[74701]:     </memballoon>
Oct 20 13:25:21 user nova-compute[74701]:   </devices>
Oct 20 13:25:21 user nova-compute[74701]: </domain>
Oct 20 13:25:21 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='57dd95cf-8ed8-45b5-9325-3a125a901fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-194972029',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member',shelved_at='2023-10-20T13:23:21.355168',shelved_host='user',shelved_image_id='57dd95cf-8ed8-45b5-9325-3a125a901fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG os_vif [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29d5ad96-908f-577d-bb71-d7c8bcf7b689', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3753e7a7-d8, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3753e7a7-d8, col_values=(('qos', UUID('6f0545a7-e97b-427e-b2ee-4531fbad6ff1')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3753e7a7-d8, col_values=(('external_ids', {'iface-id': '3753e7a7-d8ec-4e83-a888-19793f0d839a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:54:76', 'vm-uuid': '8fc7fb59-af87-4358-a67f-1f2d6abb9a56'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:21 user nova-compute[74701]: INFO os_vif [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8')
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:25:21 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] No VIF found with MAC fa:16:3e:d2:54:76, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:25:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG nova.compute.manager [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:23 user nova-compute[74701]: WARNING nova.compute.manager [req-cef2ab7f-4ebc-4167-9e98-a02ceb144428 req-b86b4e59-e62a-42b5-8860-c66fd2d84804 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 13:25:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:25:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance spawned successfully.
Oct 20 13:25:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:25:25 user nova-compute[74701]: WARNING nova.compute.manager [req-d3ce3c7b-45bc-47f0-b29d-d393e3b2bcc5 req-31e4e03b-48bd-449b-b8a9-916c9dca8903 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 13:25:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:25:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4792aeb1-638a-4e3e-88c3-deb7048b4a90 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.096s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received event network-changed-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Refreshing instance network info cache due to event network-changed-399f49a1-91b6-49e7-9105-a831a5b476f8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] Acquiring lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] Acquired lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Refreshing network info cache for port 399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:25:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:25:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Ignoring supplied device name: /dev/vdb
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updated VIF entry in instance network info cache for port 399f49a1-91b6-49e7-9105-a831a5b476f8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updating instance_info_cache with network_info: [{"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-09d18cfc-7190-4e13-ac31-bb701f013f42 req-8f7ae6c0-1d0c-4b05-ae1b-e04a5c45457a service nova] Releasing lock "refresh_cache-a8760f22-731c-48ad-9c3b-253acfb402cb" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:25:52 user nova-compute[74701]: INFO nova.compute.manager [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Attaching volume 9ff5c186-2892-450d-bc73-7740a52cbafb to /dev/vdb
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c752bade-6929-4197-b452-4526a9f997c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd7c79e-3bc7-4f6f-a4ac-d9fc09de7e50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7edc04-cedb-4980-8e5e-47068ec03cc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebcc331-eb7a-46c9-a126-dcc99cafa033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:25:52 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:25:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36fb93a-156e-449a-bd84-95aae8428105]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:25:52 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updating existing volume attachment record: cc2f2f01-11fc-47ce-9145-b7770cad4c2d {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:25:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:25:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:25:58 user nova-compute[74701]: INFO nova.compute.manager [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] instance snapshotting
Oct 20 13:25:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Beginning live snapshot process
Oct 20 13:25:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json -f qcow2 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b.delta 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:25:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b.delta 1073741824" returned: 0 in 0.054s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:25:59 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 13:25:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:26:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] COPY block job progress, current cursor: 47906816 final cursor: 75563008 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:26:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74701) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 13:26:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 13:26:01 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:26:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b.delta /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b.delta /opt/stack/data/nova/instances/snapshots/tmphwskjk3k/fea6df213f40422c94e72a3a1231a06b" returned: 0 in 0.827s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Snapshot extracted, beginning image upload
Oct 20 13:26:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Snapshot image upload complete
Oct 20 13:26:04 user nova-compute[74701]: INFO nova.compute.manager [None req-4ca9e845-8121-4946-a865-09a375c774a2 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Took 6.56 seconds to snapshot the instance on the hypervisor.
Oct 20 13:26:05 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:05 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:26:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:26:07 user nova-compute[74701]: INFO nova.compute.claims [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Claim successful on node user
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:07 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:26:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:26:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Creating image(s)
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "/opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "/opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "/opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "c412c19795cfbbf56162719b40b7fbd62e268a04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "c412c19795cfbbf56162719b40b7fbd62e268a04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:08 user nova-compute[74701]: DEBUG nova.policy [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '819014923a4d471fa9a109ba59da3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d12fee426e4728a322fc03e1f2d506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc/disk --force-share --output=json" returned: 0 in 1.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG nova.virt.images [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] e6ff2385-83f6-45ac-b50d-fa684d20e477 was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.part /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.part /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.converted" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "c412c19795cfbbf56162719b40b7fbd62e268a04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.873s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Successfully created port: 98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "c412c19795cfbbf56162719b40b7fbd62e268a04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "c412c19795cfbbf56162719b40b7fbd62e268a04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04,backing_fmt=raw /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04,backing_fmt=raw /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk 1073741824" returned: 0 in 0.058s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "c412c19795cfbbf56162719b40b7fbd62e268a04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Ensure instance console log exists: /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzXeEFpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:26:10 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:26:10 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:26:10 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea38549-85f2-4516-aeb4-a690e8d8b0dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:26:10 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc5de25-3637-494a-b728-aa9547992784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb] added
Oct 20 13:26:10 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c4a813-fe38-45ac-a009-8a0953348c99]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Successfully updated port: 98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d008c369-3782-496a-91f3-35416627b1d8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing instance network info cache due to event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] Acquiring lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] Acquired lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing network info cache for port 98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzXeEFpV {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:26:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7565MB free_disk=24.73129653930664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzXeEFpV" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[291a858f-9abc-49b6-af94-8d4c99ca65a6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzXeEFpV'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb34c4a-5959-40de-9c9f-887b65ea6984]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9edf9-4f3a-4df2-b319-04e3aa28d2e9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[786927f4-3871-46da-97d3-93ccbfb282da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260]
Oct 20 13:26:11 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260] successful.
Oct 20 13:26:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9dbb5296-c900-469d-8402-892639ec49ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a8760f22-731c-48ad-9c3b-253acfb402cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1ca8d46a-95cf-4521-a5db-e0d3d21294cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 69aa6501-6507-4322-9010-05a2004fed89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f330228c-53c8-406c-923c-0ce79e01ba63]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1fe77d-013e-42bf-8fc0-b107ad311a76]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.744s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65838ba-6cf6-4b24-bacc-d6f127bd9998]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzXeEFpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.network.neutron [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-60ea316d-30e3-40d4-8206-98b4323647a3 req-cc89cb07-b9ae-4326-8537-8b02c598625e service nova] Releasing lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquired lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.869s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [{"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Releasing lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance network_info: |[{"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Start _get_guest_xml network_info=[{"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0303e926449ac8601435d258a3365497',container_format='bare',created_at=2023-10-20T13:25:58Z,direct_url=<?>,disk_format='qcow2',id=e6ff2385-83f6-45ac-b50d-fa684d20e477,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1738921304',owner='04d12fee426e4728a322fc03e1f2d506',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:26:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': 'e6ff2385-83f6-45ac-b50d-fa684d20e477'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:26:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:26:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0303e926449ac8601435d258a3365497',container_format='bare',created_at=2023-10-20T13:25:58Z,direct_url=<?>,disk_format='qcow2',id=e6ff2385-83f6-45ac-b50d-fa684d20e477,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1738921304',owner='04d12fee426e4728a322fc03e1f2d506',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T13:26:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-882414009',display_name='tempest-TestStampPattern-server-882414009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-882414009',id=38,image_ref='e6ff2385-83f6-45ac-b50d-fa684d20e477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-h0gni6cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f5fa149e-2c53-42c6-8582-8dc13ea18857',image_min_disk='1',image_min_ram='0',image_owner_id='04d12fee426e4728a322fc03e1f2d506',image_owner_project_name='tempest-TestStampPattern-1055047061',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055047061-project-member',image_user_id='819014923a4d471fa9a109ba59da3ed5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:26:08Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=69aa6501-6507-4322-9010-05a2004fed89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'pci_devices' on Instance uuid 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:26:12 user nova-compute[74701]:   <uuid>69aa6501-6507-4322-9010-05a2004fed89</uuid>
Oct 20 13:26:12 user nova-compute[74701]:   <name>instance-00000026</name>
Oct 20 13:26:12 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:26:12 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:26:12 user nova-compute[74701]:   <metadata>
Oct 20 13:26:12 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:26:12 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:name>tempest-TestStampPattern-server-882414009</nova:name>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:26:12</nova:creationTime>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:26:12 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:26:12 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:owner>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:user uuid="819014923a4d471fa9a109ba59da3ed5">tempest-TestStampPattern-1055047061-project-member</nova:user>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:project uuid="04d12fee426e4728a322fc03e1f2d506">tempest-TestStampPattern-1055047061</nova:project>
Oct 20 13:26:12 user nova-compute[74701]:       </nova:owner>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:root type="image" uuid="e6ff2385-83f6-45ac-b50d-fa684d20e477"/>
Oct 20 13:26:12 user nova-compute[74701]:       <nova:ports>
Oct 20 13:26:12 user nova-compute[74701]:         <nova:port uuid="98cbbebf-6655-4498-88b0-5d4bc2905883">
Oct 20 13:26:12 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 13:26:12 user nova-compute[74701]:         </nova:port>
Oct 20 13:26:12 user nova-compute[74701]:       </nova:ports>
Oct 20 13:26:12 user nova-compute[74701]:     </nova:instance>
Oct 20 13:26:12 user nova-compute[74701]:   </metadata>
Oct 20 13:26:12 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:26:12 user nova-compute[74701]:     <system>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="serial">69aa6501-6507-4322-9010-05a2004fed89</entry>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="uuid">69aa6501-6507-4322-9010-05a2004fed89</entry>
Oct 20 13:26:12 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:26:12 user nova-compute[74701]:     </system>
Oct 20 13:26:12 user nova-compute[74701]:   </sysinfo>
Oct 20 13:26:12 user nova-compute[74701]:   <os>
Oct 20 13:26:12 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:26:12 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:26:12 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:26:12 user nova-compute[74701]:   </os>
Oct 20 13:26:12 user nova-compute[74701]:   <features>
Oct 20 13:26:12 user nova-compute[74701]:     <acpi/>
Oct 20 13:26:12 user nova-compute[74701]:     <apic/>
Oct 20 13:26:12 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:26:12 user nova-compute[74701]:   </features>
Oct 20 13:26:12 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:26:12 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:26:12 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:26:12 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:26:12 user nova-compute[74701]:   </clock>
Oct 20 13:26:12 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:26:12 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:26:12 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:26:12 user nova-compute[74701]:   </cpu>
Oct 20 13:26:12 user nova-compute[74701]:   <devices>
Oct 20 13:26:12 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:26:12 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:26:12 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk"/>
Oct 20 13:26:12 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:26:12 user nova-compute[74701]:     </disk>
Oct 20 13:26:12 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:26:12 user nova-compute[74701]:       <mac address="fa:16:3e:ca:4d:e9"/>
Oct 20 13:26:12 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:26:12 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:26:12 user nova-compute[74701]:       <target dev="tap98cbbebf-66"/>
Oct 20 13:26:12 user nova-compute[74701]:     </interface>
Oct 20 13:26:12 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:26:12 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/console.log" append="off"/>
Oct 20 13:26:12 user nova-compute[74701]:     </serial>
Oct 20 13:26:12 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:26:12 user nova-compute[74701]:     <video>
Oct 20 13:26:12 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:26:12 user nova-compute[74701]:     </video>
Oct 20 13:26:12 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:26:12 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:26:12 user nova-compute[74701]:     </rng>
Oct 20 13:26:12 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:26:12 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:26:12 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:26:12 user nova-compute[74701]:     </memballoon>
Oct 20 13:26:12 user nova-compute[74701]:   </devices>
Oct 20 13:26:12 user nova-compute[74701]: </domain>
Oct 20 13:26:12 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-882414009',display_name='tempest-TestStampPattern-server-882414009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-882414009',id=38,image_ref='e6ff2385-83f6-45ac-b50d-fa684d20e477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-h0gni6cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f5fa149e-2c53-42c6-8582-8dc13ea18857',image_min_disk='1',image_min_ram='0',image_owner_id='04d12fee426e4728a322fc03e1f2d506',image_owner_project_name='tempest-TestStampPattern-1055047061',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055047061-project-member',image_user_id='819014923a4d471fa9a109ba59da3ed5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:26:08Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=69aa6501-6507-4322-9010-05a2004fed89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG os_vif [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bcc12f8-27d3-5a1b-a88d-1f405037bacf', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cbbebf-66, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98cbbebf-66, col_values=(('qos', UUID('f87fa771-0062-4933-9a5a-e050301221b4')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98cbbebf-66, col_values=(('external_ids', {'iface-id': '98cbbebf-6655-4498-88b0-5d4bc2905883', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:4d:e9', 'vm-uuid': '69aa6501-6507-4322-9010-05a2004fed89'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:12 user nova-compute[74701]: INFO os_vif [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66')
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No VIF found with MAC fa:16:3e:ca:4d:e9, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.783s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== connect_volume: return (1785ms) {'type': 'block', 'scsi_wwn': '23031343736623665', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031343736623665', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:26:12 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:26:12 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:26:12 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:26:12 user nova-compute[74701]:   <serial>9ff5c186-2892-450d-bc73-7740a52cbafb</serial>
Oct 20 13:26:12 user nova-compute[74701]: </disk>
Oct 20 13:26:12 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No VIF found with MAC fa:16:3e:d7:a1:06, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f01810cd-7a5c-482d-8ac2-95ec5e1cd042 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.929s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] No waiting events found dispatching network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:14 user nova-compute[74701]: WARNING nova.compute.manager [req-2556bdad-8585-4ecc-ba4c-2f037e085204 req-0f5cada9-d99e-42b7-baa4-a6193a2bd053 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received unexpected event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 for instance with vm_state building and task_state spawning.
Oct 20 13:26:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] No waiting events found dispatching network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:16 user nova-compute[74701]: WARNING nova.compute.manager [req-e217ca15-e045-45a3-ab92-d6a2a9efe483 req-1c51a665-46bc-4e9d-8db3-507ba4b09fde service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received unexpected event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 for instance with vm_state building and task_state spawning.
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:26:16 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance spawned successfully.
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:26:16 user nova-compute[74701]: INFO nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Took 8.56 seconds to spawn the instance on the hypervisor.
Oct 20 13:26:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:26:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:16 user nova-compute[74701]: INFO nova.compute.manager [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Took 9.62 seconds to build instance.
Oct 20 13:26:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-999eaed1-9f37-4383-a520-44e71395a663 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.729s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:19 user nova-compute[74701]: INFO nova.compute.manager [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Terminating instance
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-unplugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] No waiting events found dispatching network-vif-unplugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-e06c75aa-4ff1-45ac-87ee-993564ab9d22 req-41965cd2-797c-4f4f-9a18-e4d588d427a2 service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-unplugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:26:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Instance destroyed successfully.
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lazy-loading 'resources' on Instance uuid 1ca8d46a-95cf-4521-a5db-e0d3d21294cc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2035862210',display_name='tempest-VolumesNegativeTest-instance-2035862210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2035862210',id=36,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9286eb0e37747e5bddf389b90c0fd4c',ramdisk_id='',reservation_id='r-1c8sp9jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1884091354',owner_user_name='tempest-VolumesNegativeTest-1884091354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:24:36Z,user_data=None,user_id='f3d2ceee53714d8692f2f91e305ac585',uuid=1ca8d46a-95cf-4521-a5db-e0d3d21294cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converting VIF {"id": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "address": "fa:16:3e:18:30:df", "network": {"id": "8344069d-0019-479e-8e1e-09be8a1f81cb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3655a5a7485450ba27f28d13af59d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183f7a8f-d9", "ovs_interfaceid": "183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG os_vif [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183f7a8f-d9, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74f72c76-ad25-43f4-98e9-634677113503) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:19 user nova-compute[74701]: INFO os_vif [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:df,bridge_name='br-int',has_traffic_filtering=True,id=183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772,network=Network(8344069d-0019-479e-8e1e-09be8a1f81cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183f7a8f-d9')
Oct 20 13:26:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Deleting instance files /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc_del
Oct 20 13:26:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Deletion of /opt/stack/data/nova/instances/1ca8d46a-95cf-4521-a5db-e0d3d21294cc_del complete
Oct 20 13:26:19 user nova-compute[74701]: INFO nova.compute.manager [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 13:26:19 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:26:19 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:20 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Took 0.50 seconds to deallocate network for instance.
Oct 20 13:26:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-01df5841-fea2-4c22-b91c-17e8e913aa71 req-69f1462d-8af0-4361-9bc0-f26a851ab6bd service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-deleted-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:26:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:21 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Deleted allocations for instance 1ca8d46a-95cf-4521-a5db-e0d3d21294cc
Oct 20 13:26:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3a7de287-aadd-4945-8878-19883dda5ad0 tempest-VolumesNegativeTest-1884091354 tempest-VolumesNegativeTest-1884091354-project-member] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] Acquiring lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] Lock "1ca8d46a-95cf-4521-a5db-e0d3d21294cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:21 user nova-compute[74701]: DEBUG nova.compute.manager [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] No waiting events found dispatching network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:21 user nova-compute[74701]: WARNING nova.compute.manager [req-0129d8ef-7cfd-4b87-983e-672c4c75ed39 req-5aded02a-7e69-451e-a3d5-d1f232ae520a service nova] [instance: 1ca8d46a-95cf-4521-a5db-e0d3d21294cc] Received unexpected event network-vif-plugged-183f7a8f-d98d-4c7f-8a5b-adfc9bf5e772 for instance with vm_state deleted and task_state None.
Oct 20 13:26:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:26:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:26 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:26:26 user nova-compute[74701]: INFO nova.compute.claims [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Claim successful on node user
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:26:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.policy [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9189507d4d4f4faeb52d1f6b1fcb17d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0182e44f51fb425c8cd560e7a42da61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:26:27 user nova-compute[74701]: INFO nova.virt.block_device [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Booting with volume e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd at /dev/vda
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.utils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1322dd6d-f775-4ebb-8ace-dfb06d3f8466]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9098c-e189-4e42-9d23-7d677285f5a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a0667-9609-44e1-9266-8a4dadd31053]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e94198b-113b-4277-9036-b1f09c5c6636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:26:27 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:26:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751c385-d1bb-464e-877f-6a97908f9871]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG os_brick.utils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:26:27 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating existing volume attachment record: 1aed6be8-37e6-42f5-8b6a-56afe037dcf2 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:26:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Successfully created port: ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Successfully updated port: ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-changed-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Refreshing instance network info cache due to event network-changed-ed74ca21-24c2-4479-8d07-971fc22f3b29. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance network_info: |[{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Refreshing network info cache for port ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updated VIF entry in instance network info cache for port ed74ca21-24c2-4479-8d07-971fc22f3b29. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-cd71bb5b-b8e6-44fb-ab60-9c9917433222 req-2c0787da-b135-4644-a33e-115101c6599a service nova] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-changed-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Refreshing instance network info cache due to event network-changed-7bc61d81-aed3-4a1d-8243-1affa2da3280. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Refreshing network info cache for port 7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updated VIF entry in instance network info cache for port 7bc61d81-aed3-4a1d-8243-1affa2da3280. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-72709b81-7cef-418f-b420-b831c5314f8d req-a72b3c55-ac0a-4160-94f3-09172c77d21e service nova] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:35 user nova-compute[74701]: INFO nova.compute.manager [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Attaching volume d42c4367-71c5-489b-a55a-8db2367be42c to /dev/vdb
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf940b92-3c55-435e-84a9-c34d68b63078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfcb23-bb9f-4ba2-82f9-ca0426967cc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439cac1-1d6f-467d-864a-8378c3a62e2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3048fc9e-ad97-425f-958a-caf8fb6fee9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:26:35 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:26:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d5f869-3a7b-4122-aea7-fab8fba9eea6]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:26:35 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating existing volume attachment record: cfd70040-7c22-4f03-acd0-da2fff75ffd6 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:26:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:26:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:26:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:26:53 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e0b215-b040-401e-bbf4-706207225c9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:26:53 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d356dbd-27aa-43fd-97f6-1767cc68a375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c] added
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[168d9f19-a307-42d1-be98-1534a32c8ce0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e9f74d-5b6e-4b3f-81dc-3f7e8e2de4eb]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkVCquhR {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkVCquhR" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c163dbf-4a2c-4c41-9d57-b810d0cf9392]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkVCquhR'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed6cede-a42e-4848-b307-56d33b1f5ad8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a791a-9dbd-4be9-8098-aeb6edf568c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c49f8-9a4b-40d3-8b8b-44422fd03a3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]
Oct 20 13:26:53 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd608a-7db5-4609-89b7-9f07f97d18ab]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1c9c6-adf5-4591-a6ad-277d4c8675c0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:26:53 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:26:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[63465e2d-1167-4f31-9c50-4573c00fcdad]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:26:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:26:54 user nova-compute[74701]: INFO nova.compute.manager [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Unrescuing
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquired lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.network.neutron [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.network.neutron [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating instance_info_cache with network_info: [{"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Releasing lock "refresh_cache-9dbb5296-c900-469d-8402-892639ec49ea" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'flavor' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23638363839633666', 'path': '/dev/sde'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638363839633666', 'path': '/dev/sde'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:26:54 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:26:54 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:26:54 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:26:54 user nova-compute[74701]:   <serial>d42c4367-71c5-489b-a55a-8db2367be42c</serial>
Oct 20 13:26:54 user nova-compute[74701]: </disk>
Oct 20 13:26:54 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:54 user nova-compute[74701]: WARNING nova.compute.manager [req-1d2a06af-d03f-4456-9f8a-fdab5c14a0ac req-ce959e81-29e3-41ba-b7e5-99f37aa5a818 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:26:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:26:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:26:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No VIF found with MAC fa:16:3e:f5:d0:67, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:26:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-49d7dc5f-14bb-4cf5-bddd-e70dd977354e tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.698s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:55 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance destroyed successfully.
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74701) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:56 user nova-compute[74701]: WARNING nova.compute.manager [req-d33ecb6c-4a08-43d8-ad55-97869d017a2f req-dea8ff8a-438e-47f0-9700-eb3980aad47d service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state active and task_state powering-off.
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:56 user nova-compute[74701]: WARNING nova.compute.manager [req-715da8e4-e90b-4ce2-8271-0ca8423b5347 req-5bc95fe7-252b-4d9a-92d4-ada85d96f11e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:26:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance destroyed successfully.
Oct 20 13:26:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:26:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bbdb2194-201e-4ef9-9230-795243d600c4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:58 user nova-compute[74701]: WARNING nova.compute.manager [req-f5033bd4-3964-40fa-9b91-afdebfe709b4 req-364be56d-a4f8-4a2d-a5e4-e3dd5a663515 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state stopped and task_state None.
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:59 user nova-compute[74701]: WARNING nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:59 user nova-compute[74701]: WARNING nova.compute.manager [req-c6d8e538-bd57-4500-a9db-190bfc6de4be req-7b043371-a817-40ca-85b3-b2c94252731e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-142ef341-2bbb-4b6c-ae26-2229e9b1a4c3 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:59 user nova-compute[74701]: INFO nova.compute.manager [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Terminating instance
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-1e3741c4-4998-4141-8925-d462a7ae80c9 req-ab3b722e-0f0b-4512-b742-882003d8b6a1 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-unplugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:26:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Instance destroyed successfully.
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lazy-loading 'resources' on Instance uuid 8fc7fb59-af87-4358-a67f-1f2d6abb9a56 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245423320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245423320',id=32,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOyiLPG43sf8nTt6IdNQyV81L+L8gnxG8o7EsoHItaOu4r39dqcrkLJviW7zglttU3kDgBbImUjSllgkkT2IT1V2vOgacq/jGB69IMuUKNL2UNlpPrglBw/MA7ykxyY2Q==',key_name='tempest-keypair-194972029',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf15939da12479f9c7bfff1c4198efe',ramdisk_id='',reservation_id='r-inc8cov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1805146529',owner_user_name='tempest-AttachVolumeShelveTestJSON-1805146529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:25:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22371d97e6c1416499916660b5b2b07e',uuid=8fc7fb59-af87-4358-a67f-1f2d6abb9a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converting VIF {"id": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "address": "fa:16:3e:d2:54:76", "network": {"id": "4308b651-06ec-40cf-873d-f5e0c48a7591", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1891453698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf15939da12479f9c7bfff1c4198efe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753e7a7-d8", "ovs_interfaceid": "3753e7a7-d8ec-4e83-a888-19793f0d839a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG os_vif [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3753e7a7-d8, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f0545a7-e97b-427e-b2ee-4531fbad6ff1) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:00 user nova-compute[74701]: INFO os_vif [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:54:76,bridge_name='br-int',has_traffic_filtering=True,id=3753e7a7-d8ec-4e83-a888-19793f0d839a,network=Network(4308b651-06ec-40cf-873d-f5e0c48a7591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753e7a7-d8')
Oct 20 13:27:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Deleting instance files /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56_del
Oct 20 13:27:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Deletion of /opt/stack/data/nova/instances/8fc7fb59-af87-4358-a67f-1f2d6abb9a56_del complete
Oct 20 13:27:00 user nova-compute[74701]: INFO nova.compute.manager [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 13:27:00 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:00 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Took 0.75 seconds to deallocate network for instance.
Oct 20 13:27:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-5dfcd327-e80f-4d48-9f3c-6241929a60d8 req-f47a06a2-6595-45db-b6b5-577be8eb60e8 service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-deleted-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:01 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Deleted allocations for instance 8fc7fb59-af87-4358-a67f-1f2d6abb9a56
Oct 20 13:27:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ad26ed76-4bd4-40f2-b84b-ffb96527e284 tempest-AttachVolumeShelveTestJSON-1805146529 tempest-AttachVolumeShelveTestJSON-1805146529-project-member] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] Acquiring lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] Lock "8fc7fb59-af87-4358-a67f-1f2d6abb9a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] No waiting events found dispatching network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:01 user nova-compute[74701]: WARNING nova.compute.manager [req-8eee5b94-d0c9-4938-a9a6-61ecc771a778 req-93e2278e-b6fd-464d-ba88-7e3a90ee296e service nova] [instance: 8fc7fb59-af87-4358-a67f-1f2d6abb9a56] Received unexpected event network-vif-plugged-3753e7a7-d8ec-4e83-a888-19793f0d839a for instance with vm_state deleted and task_state None.
Oct 20 13:27:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:03 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:27:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=24.67986297607422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9dbb5296-c900-469d-8402-892639ec49ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance a8760f22-731c-48ad-9c3b-253acfb402cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 69aa6501-6507-4322-9010-05a2004fed89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:27:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:12 user nova-compute[74701]: INFO nova.compute.manager [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Detaching volume 9ff5c186-2892-450d-bc73-7740a52cbafb
Oct 20 13:27:12 user nova-compute[74701]: INFO nova.virt.block_device [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Attempting to driver detach volume 9ff5c186-2892-450d-bc73-7740a52cbafb from mountpoint /dev/vdb
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Attempting to detach device vdb from instance a8760f22-731c-48ad-9c3b-253acfb402cb from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:27:12 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:27:12 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:27:12 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:27:12 user nova-compute[74701]:   <serial>9ff5c186-2892-450d-bc73-7740a52cbafb</serial>
Oct 20 13:27:12 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:27:12 user nova-compute[74701]: </disk>
Oct 20 13:27:12 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:27:12 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully detached device vdb from instance a8760f22-731c-48ad-9c3b-253acfb402cb from the persistent domain config.
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8760f22-731c-48ad-9c3b-253acfb402cb from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:27:12 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:27:12 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:27:12 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:27:12 user nova-compute[74701]:   <serial>9ff5c186-2892-450d-bc73-7740a52cbafb</serial>
Oct 20 13:27:12 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:27:12 user nova-compute[74701]: </disk>
Oct 20 13:27:12 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [{"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4053c98d-7a1e-4019-84b5-0ae71af9ff95" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:16 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:27:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:27:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:27:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Creating image(s)
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Ensure instance console log exists: /opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start _get_guest_xml network_info=[{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '581e2c46-293f-40a8-90bc-44188395eaba', 'attached_at': '', 'detached_at': '', 'volume_id': 'e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'serial': 'e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd'}, 'attachment_id': '1aed6be8-37e6-42f5-8b6a-56afe037dcf2', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:27:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:27:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:27:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:27:27 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af78d8c-9c40-42a2-8730-3144a2a9fe69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:27:27 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef8c93-3e8c-46ed-98c5-fe8c71d9e0f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd] added
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b52f4f-df0e-41ae-bc20-785fa87916dd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ae39e-b6f3-4437-bd51-bc631cb94c8e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTHUPWro {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTHUPWro" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8ef98-ac25-45b3-9b4f-5b523554730a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTHUPWro'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8753ab3e-bde3-4dfa-bbc2-02295388a649]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d7cd4-dc28-44e6-a1aa-64aa3e7c55e9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca98b69d-86a7-4e42-bbed-42df7919db50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]
Oct 20 13:27:27 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa435a-887a-48bf-b387-05825b11e6bf]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[289affe5-8ff0-4b68-8139-4560cb94588e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:27 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c31a33-2b6d-4c57-a109-1d536da7c01f]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23264356239663233', 'path': '/dev/sdf'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264356239663233', 'path': '/dev/sdf'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'pci_devices' on Instance uuid 581e2c46-293f-40a8-90bc-44188395eaba {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:27:28 user nova-compute[74701]:   <uuid>581e2c46-293f-40a8-90bc-44188395eaba</uuid>
Oct 20 13:27:28 user nova-compute[74701]:   <name>instance-00000027</name>
Oct 20 13:27:28 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:27:28 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:27:28 user nova-compute[74701]:   <metadata>
Oct 20 13:27:28 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:27:28 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:27:28 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherA-server-470408425</nova:name>
Oct 20 13:27:28 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:27:27</nova:creationTime>
Oct 20 13:27:28 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:27:28 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:27:28 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:27:28 user nova-compute[74701]:       <nova:owner>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:user uuid="9189507d4d4f4faeb52d1f6b1fcb17d8">tempest-ServerActionsTestOtherA-1694438458-project-member</nova:user>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:project uuid="0182e44f51fb425c8cd560e7a42da61f">tempest-ServerActionsTestOtherA-1694438458</nova:project>
Oct 20 13:27:28 user nova-compute[74701]:       </nova:owner>
Oct 20 13:27:28 user nova-compute[74701]:       <nova:ports>
Oct 20 13:27:28 user nova-compute[74701]:         <nova:port uuid="ed74ca21-24c2-4479-8d07-971fc22f3b29">
Oct 20 13:27:28 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:27:28 user nova-compute[74701]:         </nova:port>
Oct 20 13:27:28 user nova-compute[74701]:       </nova:ports>
Oct 20 13:27:28 user nova-compute[74701]:     </nova:instance>
Oct 20 13:27:28 user nova-compute[74701]:   </metadata>
Oct 20 13:27:28 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:27:28 user nova-compute[74701]:     <system>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="serial">581e2c46-293f-40a8-90bc-44188395eaba</entry>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="uuid">581e2c46-293f-40a8-90bc-44188395eaba</entry>
Oct 20 13:27:28 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:27:28 user nova-compute[74701]:     </system>
Oct 20 13:27:28 user nova-compute[74701]:   </sysinfo>
Oct 20 13:27:28 user nova-compute[74701]:   <os>
Oct 20 13:27:28 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:27:28 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:27:28 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:27:28 user nova-compute[74701]:   </os>
Oct 20 13:27:28 user nova-compute[74701]:   <features>
Oct 20 13:27:28 user nova-compute[74701]:     <acpi/>
Oct 20 13:27:28 user nova-compute[74701]:     <apic/>
Oct 20 13:27:28 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:27:28 user nova-compute[74701]:   </features>
Oct 20 13:27:28 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:27:28 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:27:28 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:27:28 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:27:28 user nova-compute[74701]:   </clock>
Oct 20 13:27:28 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:27:28 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:27:28 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:27:28 user nova-compute[74701]:   </cpu>
Oct 20 13:27:28 user nova-compute[74701]:   <devices>
Oct 20 13:27:28 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:27:28 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:27:28 user nova-compute[74701]:       <source dev="/dev/sdf"/>
Oct 20 13:27:28 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:27:28 user nova-compute[74701]:       <serial>e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd</serial>
Oct 20 13:27:28 user nova-compute[74701]:     </disk>
Oct 20 13:27:28 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:27:28 user nova-compute[74701]:       <mac address="fa:16:3e:bc:56:e6"/>
Oct 20 13:27:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:28 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:27:28 user nova-compute[74701]:       <target dev="taped74ca21-24"/>
Oct 20 13:27:28 user nova-compute[74701]:     </interface>
Oct 20 13:27:28 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:27:28 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba/console.log" append="off"/>
Oct 20 13:27:28 user nova-compute[74701]:     </serial>
Oct 20 13:27:28 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:27:28 user nova-compute[74701]:     <video>
Oct 20 13:27:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:28 user nova-compute[74701]:     </video>
Oct 20 13:27:28 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:27:28 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:27:28 user nova-compute[74701]:     </rng>
Oct 20 13:27:28 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:27:28 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:27:28 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:27:28 user nova-compute[74701]:     </memballoon>
Oct 20 13:27:28 user nova-compute[74701]:   </devices>
Oct 20 13:27:28 user nova-compute[74701]: </domain>
Oct 20 13:27:28 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG os_vif [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '589d510b-dfa9-5ca3-bd0e-647b10f7c258', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped74ca21-24, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped74ca21-24, col_values=(('qos', UUID('098c0702-3ad2-4405-9083-8c2a0b8ae3eb')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped74ca21-24, col_values=(('external_ids', {'iface-id': 'ed74ca21-24c2-4479-8d07-971fc22f3b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:56:e6', 'vm-uuid': '581e2c46-293f-40a8-90bc-44188395eaba'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:28 user nova-compute[74701]: INFO os_vif [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24')
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:27:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No VIF found with MAC fa:16:3e:bc:56:e6, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:30 user nova-compute[74701]: WARNING nova.compute.manager [req-3facb51a-8365-4805-8d93-68d68af601f7 req-3f2b6d08-216b-42e1-90c4-e114628f62cb service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state building and task_state spawning.
Oct 20 13:27:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:27:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance spawned successfully.
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:32 user nova-compute[74701]: WARNING nova.compute.manager [req-af577a19-bf3a-4c11-ae71-ee3e0be0874b req-bd21d190-c740-46fc-903b-b0e6b6084553 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state building and task_state spawning.
Oct 20 13:27:32 user nova-compute[74701]: INFO nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:27:32 user nova-compute[74701]: INFO nova.compute.manager [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Took 65.81 seconds to build instance.
Oct 20 13:27:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8b92b538-e677-4c2d-975f-cdf1d8b8b711 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 65.927s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8760f22-731c-48ad-9c3b-253acfb402cb is timed out.
Oct 20 13:27:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully detached device vdb from instance a8760f22-731c-48ad-9c3b-253acfb402cb from the live domain config.
Oct 20 13:27:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzXeEFpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:27:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:27:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:27:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[308043fe-54b2-4f85-9b17-714bdf63692b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:27:33 user nova-compute[74701]: No targets found.
Oct 20 13:27:33 user nova-compute[74701]: iSNS:
Oct 20 13:27:33 user nova-compute[74701]: No targets found.
Oct 20 13:27:33 user nova-compute[74701]: STATIC:
Oct 20 13:27:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:27:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:27:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb
Oct 20 13:27:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb
Oct 20 13:27:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:33 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:27:33 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:33 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:33 user nova-compute[74701]: FIRMWARE:
Oct 20 13:27:33 user nova-compute[74701]: No targets found.
Oct 20 13:27:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:27:33 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:27:33 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0212d0-e8f2-4180-94e4-ec7f1f937947]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600d87f-1ccf-4cfd-b09f-9676caf088f6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:33 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0619e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff1dddf-bc39-4a8c-9f2d-128ca5e915a9]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[51805575-e79b-4817-9c98-aa0ac7e89f70]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8315dd6-cf98-41ad-a394-cbc680e59e67]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.081s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d20e4-a408-418e-8ffd-b3d1d6eab450]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3177f54e-6c3d-4c22-bc0e-70fd28df1ead]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6196ed-eec6-4136-9ed2-fcca58b32daa]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260]
Oct 20 13:27:33 user nova-compute[74701]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb, portal: 172.16.0.220,3260] successful.
Oct 20 13:27:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0789d1-42d9-40cd-9875-1b909e828d29]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== disconnect_volume: return (417ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:27:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-abf21bae-263b-4955-8218-6b0d8d13b0e3 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.858s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:34 user nova-compute[74701]: INFO nova.compute.manager [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Terminating instance
Oct 20 13:27:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Instance destroyed successfully.
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'resources' on Instance uuid a8760f22-731c-48ad-9c3b-253acfb402cb {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-28556790',display_name='tempest-VolumesSnapshotTestJSON-instance-28556790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-28556790',id=35,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINhgALx1cfh4IH5eJOcWa3jRYD5E4vEJHwRReSdt/cdBA4G9EDZjx9ipmbzc8+qs819nqVrru7WELZD35cb6EZPuAHQ0M8bMXhDs7XhEhv/KBHSVBrJecV20TS3Ffy7Yg==',key_name='tempest-keypair-2017146645',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-wl4hqazf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=a8760f22-731c-48ad-9c3b-253acfb402cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "399f49a1-91b6-49e7-9105-a831a5b476f8", "address": "fa:16:3e:d7:a1:06", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f49a1-91", "ovs_interfaceid": "399f49a1-91b6-49e7-9105-a831a5b476f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_vif [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap399f49a1-91, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=092eb62d-016b-4efb-94d5-020b71861fd5) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: INFO os_vif [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a1:06,bridge_name='br-int',has_traffic_filtering=True,id=399f49a1-91b6-49e7-9105-a831a5b476f8,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f49a1-91')
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzXeEFpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:27:35 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15bdfab-a9cf-4520-a5bf-86457514fb33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:27:35 user nova-compute[74701]: No targets found.
Oct 20 13:27:35 user nova-compute[74701]: iSNS:
Oct 20 13:27:35 user nova-compute[74701]: No targets found.
Oct 20 13:27:35 user nova-compute[74701]: STATIC:
Oct 20 13:27:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:27:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:27:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb
Oct 20 13:27:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:35 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:27:35 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:27:35 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:27:35 user nova-compute[74701]: FIRMWARE:
Oct 20 13:27:35 user nova-compute[74701]: No targets found.
Oct 20 13:27:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:27:35 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:27:35 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff5c186-2892-450d-bc73-7740a52cbafb', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a774c00-2fe7-47b7-80fe-d9ebb6de4723]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b50b685-8c3d-4c2a-8669-666469e27069]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:27:35 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:27:35 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0619cf0>, {}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Disconnecting from: [] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.104s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== disconnect_volume: return (105ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:27:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Deleting instance files /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb_del
Oct 20 13:27:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Deletion of /opt/stack/data/nova/instances/a8760f22-731c-48ad-9c3b-253acfb402cb_del complete
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: INFO nova.compute.manager [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 20 13:27:35 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:37 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Took 1.62 seconds to deallocate network for instance.
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-15c15d4b-12d1-4a72-95c6-1eecc288cb21 req-94838c2e-8ddb-47b1-b8ff-79de05799feb service nova] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Received event network-vif-deleted-399f49a1-91b6-49e7-9105-a831a5b476f8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:37 user nova-compute[74701]: WARNING nova.volume.cinder [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Attachment cc2f2f01-11fc-47ce-9145-b7770cad4c2d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cc2f2f01-11fc-47ce-9145-b7770cad4c2d. (HTTP 404) (Request-ID: req-7e61a84e-4f1b-4186-b767-2b265e8270e5)
Oct 20 13:27:37 user nova-compute[74701]: INFO nova.compute.manager [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: a8760f22-731c-48ad-9c3b-253acfb402cb] Took 0.04 seconds to detach 1 volumes for instance.
Oct 20 13:27:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:27:37 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:27:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.849s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:38 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Deleted allocations for instance a8760f22-731c-48ad-9c3b-253acfb402cb
Oct 20 13:27:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-38188a96-bdc9-4546-9a5d-5e5f61d916fe tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "a8760f22-731c-48ad-9c3b-253acfb402cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.813s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:27:47 user nova-compute[74701]: INFO nova.compute.claims [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Claim successful on node user
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:27:47 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:27:47 user nova-compute[74701]: DEBUG nova.policy [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '162b18571b984806959d5fa3177bbf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce0888325924d82aa5e9bce837eab3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:27:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Creating image(s)
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "/opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "/opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "/opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk 1073741824" returned: 0 in 0.061s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Successfully created port: ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.211s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Cannot resize image /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Ensure instance console log exists: /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Successfully updated port: ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquired lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-changed-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Refreshing instance network info cache due to event network-changed-ee475172-4f64-4d3d-984a-7ce01df9c49d. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] Acquiring lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating instance_info_cache with network_info: [{"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Releasing lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Instance network_info: |[{"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] Acquired lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Refreshing network info cache for port ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Start _get_guest_xml network_info=[{"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:27:49 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:49 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1438595',id=40,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr71q4F3Gh3CEI/bgcegD1nEY3o7+wYY2ibjdnnQu0XY9twg9a9PQd/+V9Zwztvzt4Ke5wi3QIghw6E1PtLJYhUfDHBDVUixUoNQp7DzxUjOD7mj1FcS4u8qups8G1w0A==',key_name='tempest-keypair-903568916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce0888325924d82aa5e9bce837eab3d',ramdisk_id='',reservation_id='r-1006rmfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162b18571b984806959d5fa3177bbf6e',uuid=b654cfe2-500f-4ffb-85c3-8bc19631984c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converting VIF {"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.objects.instance [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lazy-loading 'pci_devices' on Instance uuid b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:27:49 user nova-compute[74701]:   <uuid>b654cfe2-500f-4ffb-85c3-8bc19631984c</uuid>
Oct 20 13:27:49 user nova-compute[74701]:   <name>instance-00000028</name>
Oct 20 13:27:49 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:27:49 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:27:49 user nova-compute[74701]:   <metadata>
Oct 20 13:27:49 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:27:49 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647</nova:name>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:27:49</nova:creationTime>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:27:49 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:27:49 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:owner>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:user uuid="162b18571b984806959d5fa3177bbf6e">tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member</nova:user>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:project uuid="3ce0888325924d82aa5e9bce837eab3d">tempest-TestServerVolumeAttachScenarioOldVersion-1178317732</nova:project>
Oct 20 13:27:49 user nova-compute[74701]:       </nova:owner>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:27:49 user nova-compute[74701]:       <nova:ports>
Oct 20 13:27:49 user nova-compute[74701]:         <nova:port uuid="ee475172-4f64-4d3d-984a-7ce01df9c49d">
Oct 20 13:27:49 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:27:49 user nova-compute[74701]:         </nova:port>
Oct 20 13:27:49 user nova-compute[74701]:       </nova:ports>
Oct 20 13:27:49 user nova-compute[74701]:     </nova:instance>
Oct 20 13:27:49 user nova-compute[74701]:   </metadata>
Oct 20 13:27:49 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:27:49 user nova-compute[74701]:     <system>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="serial">b654cfe2-500f-4ffb-85c3-8bc19631984c</entry>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="uuid">b654cfe2-500f-4ffb-85c3-8bc19631984c</entry>
Oct 20 13:27:49 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:27:49 user nova-compute[74701]:     </system>
Oct 20 13:27:49 user nova-compute[74701]:   </sysinfo>
Oct 20 13:27:49 user nova-compute[74701]:   <os>
Oct 20 13:27:49 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:27:49 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:27:49 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:27:49 user nova-compute[74701]:   </os>
Oct 20 13:27:49 user nova-compute[74701]:   <features>
Oct 20 13:27:49 user nova-compute[74701]:     <acpi/>
Oct 20 13:27:49 user nova-compute[74701]:     <apic/>
Oct 20 13:27:49 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:27:49 user nova-compute[74701]:   </features>
Oct 20 13:27:49 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:27:49 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:27:49 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:27:49 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:27:49 user nova-compute[74701]:   </clock>
Oct 20 13:27:49 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:27:49 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:27:49 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:27:49 user nova-compute[74701]:   </cpu>
Oct 20 13:27:49 user nova-compute[74701]:   <devices>
Oct 20 13:27:49 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:27:49 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:27:49 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk"/>
Oct 20 13:27:49 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:27:49 user nova-compute[74701]:     </disk>
Oct 20 13:27:49 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:27:49 user nova-compute[74701]:       <mac address="fa:16:3e:50:f8:51"/>
Oct 20 13:27:49 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:49 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:27:49 user nova-compute[74701]:       <target dev="tapee475172-4f"/>
Oct 20 13:27:49 user nova-compute[74701]:     </interface>
Oct 20 13:27:49 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:27:49 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/console.log" append="off"/>
Oct 20 13:27:49 user nova-compute[74701]:     </serial>
Oct 20 13:27:49 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:27:49 user nova-compute[74701]:     <video>
Oct 20 13:27:49 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:49 user nova-compute[74701]:     </video>
Oct 20 13:27:49 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:27:49 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:27:49 user nova-compute[74701]:     </rng>
Oct 20 13:27:49 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:27:49 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:27:49 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:27:49 user nova-compute[74701]:     </memballoon>
Oct 20 13:27:49 user nova-compute[74701]:   </devices>
Oct 20 13:27:49 user nova-compute[74701]: </domain>
Oct 20 13:27:49 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1438595',id=40,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr71q4F3Gh3CEI/bgcegD1nEY3o7+wYY2ibjdnnQu0XY9twg9a9PQd/+V9Zwztvzt4Ke5wi3QIghw6E1PtLJYhUfDHBDVUixUoNQp7DzxUjOD7mj1FcS4u8qups8G1w0A==',key_name='tempest-keypair-903568916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce0888325924d82aa5e9bce837eab3d',ramdisk_id='',reservation_id='r-1006rmfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162b18571b984806959d5fa3177bbf6e',uuid=b654cfe2-500f-4ffb-85c3-8bc19631984c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converting VIF {"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG os_vif [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7682017-7cc0-5a91-82a3-9cf7de2daf49', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee475172-4f, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee475172-4f, col_values=(('qos', UUID('1084f63b-8b1f-46d9-8375-ad457e460347')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee475172-4f, col_values=(('external_ids', {'iface-id': 'ee475172-4f64-4d3d-984a-7ce01df9c49d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:f8:51', 'vm-uuid': 'b654cfe2-500f-4ffb-85c3-8bc19631984c'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:49 user nova-compute[74701]: INFO os_vif [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f')
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] No VIF found with MAC fa:16:3e:50:f8:51, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updated VIF entry in instance network info cache for port ee475172-4f64-4d3d-984a-7ce01df9c49d. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG nova.network.neutron [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating instance_info_cache with network_info: [{"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3240b20-a064-41ad-b918-856d8e457c59 req-03dbc6b6-14d2-4baa-ba1a-cd8221372e51 service nova] Releasing lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:27:50 user nova-compute[74701]: INFO nova.compute.claims [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Claim successful on node user
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:27:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:27:50 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Creating image(s)
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "/opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "/opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.policy [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c511a58dbf04969819db3f49cadf236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70909b4823c741d3ba1a2b94d14a8b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk 1073741824" returned: 0 in 0.136s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] No waiting events found dispatching network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:51 user nova-compute[74701]: WARNING nova.compute.manager [req-267cfd74-38b5-4385-a316-371577ea3c9f req-cda3ef88-c910-47e5-8fcd-626f1e886d9c service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received unexpected event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d for instance with vm_state building and task_state spawning.
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.205s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Cannot resize image /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Ensure instance console log exists: /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Successfully created port: 90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Successfully updated port: 90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquired lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:27:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Releasing lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Instance network_info: |[{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Start _get_guest_xml network_info=[{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:27:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:53 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1218930607',display_name='tempest-SnapshotDataIntegrityTests-server-1218930607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1218930607',id=41,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbOgqjx4wE5zdCA8D8SNYrvkIaHh0BO6F5lxURDU+9rTOWTbnsBPzVSpfLXMN+PSFixKjd8+y/RlQbrKuYQw6xROp2XrTkDFSqEVWceB5HBt/awA2UEk284GsqrcZLFwQ==',key_name='tempest-keypair-824515255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70909b4823c741d3ba1a2b94d14a8b20',ramdisk_id='',reservation_id='r-mn9up78l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-224030944',owner_user_name='tempest-SnapshotDataIntegrityTests-224030944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c511a58dbf04969819db3f49cadf236',uuid=f6eae62d-6deb-4ed4-bc20-b1d6e59fca90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converting VIF {"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'pci_devices' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:27:53 user nova-compute[74701]:   <uuid>f6eae62d-6deb-4ed4-bc20-b1d6e59fca90</uuid>
Oct 20 13:27:53 user nova-compute[74701]:   <name>instance-00000029</name>
Oct 20 13:27:53 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:27:53 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:27:53 user nova-compute[74701]:   <metadata>
Oct 20 13:27:53 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:27:53 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1218930607</nova:name>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:27:53</nova:creationTime>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:27:53 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:27:53 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:owner>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:user uuid="5c511a58dbf04969819db3f49cadf236">tempest-SnapshotDataIntegrityTests-224030944-project-member</nova:user>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:project uuid="70909b4823c741d3ba1a2b94d14a8b20">tempest-SnapshotDataIntegrityTests-224030944</nova:project>
Oct 20 13:27:53 user nova-compute[74701]:       </nova:owner>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:27:53 user nova-compute[74701]:       <nova:ports>
Oct 20 13:27:53 user nova-compute[74701]:         <nova:port uuid="90e70767-0b33-4938-a5b0-28b4bc5a94ff">
Oct 20 13:27:53 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:27:53 user nova-compute[74701]:         </nova:port>
Oct 20 13:27:53 user nova-compute[74701]:       </nova:ports>
Oct 20 13:27:53 user nova-compute[74701]:     </nova:instance>
Oct 20 13:27:53 user nova-compute[74701]:   </metadata>
Oct 20 13:27:53 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:27:53 user nova-compute[74701]:     <system>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="serial">f6eae62d-6deb-4ed4-bc20-b1d6e59fca90</entry>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="uuid">f6eae62d-6deb-4ed4-bc20-b1d6e59fca90</entry>
Oct 20 13:27:53 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:27:53 user nova-compute[74701]:     </system>
Oct 20 13:27:53 user nova-compute[74701]:   </sysinfo>
Oct 20 13:27:53 user nova-compute[74701]:   <os>
Oct 20 13:27:53 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:27:53 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:27:53 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:27:53 user nova-compute[74701]:   </os>
Oct 20 13:27:53 user nova-compute[74701]:   <features>
Oct 20 13:27:53 user nova-compute[74701]:     <acpi/>
Oct 20 13:27:53 user nova-compute[74701]:     <apic/>
Oct 20 13:27:53 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:27:53 user nova-compute[74701]:   </features>
Oct 20 13:27:53 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:27:53 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:27:53 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:27:53 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:27:53 user nova-compute[74701]:   </clock>
Oct 20 13:27:53 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:27:53 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:27:53 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:27:53 user nova-compute[74701]:   </cpu>
Oct 20 13:27:53 user nova-compute[74701]:   <devices>
Oct 20 13:27:53 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:27:53 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:27:53 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk"/>
Oct 20 13:27:53 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:27:53 user nova-compute[74701]:     </disk>
Oct 20 13:27:53 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:27:53 user nova-compute[74701]:       <mac address="fa:16:3e:c1:78:65"/>
Oct 20 13:27:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:53 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:27:53 user nova-compute[74701]:       <target dev="tap90e70767-0b"/>
Oct 20 13:27:53 user nova-compute[74701]:     </interface>
Oct 20 13:27:53 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:27:53 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/console.log" append="off"/>
Oct 20 13:27:53 user nova-compute[74701]:     </serial>
Oct 20 13:27:53 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:27:53 user nova-compute[74701]:     <video>
Oct 20 13:27:53 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:27:53 user nova-compute[74701]:     </video>
Oct 20 13:27:53 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:27:53 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:27:53 user nova-compute[74701]:     </rng>
Oct 20 13:27:53 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:27:53 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:27:53 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:27:53 user nova-compute[74701]:     </memballoon>
Oct 20 13:27:53 user nova-compute[74701]:   </devices>
Oct 20 13:27:53 user nova-compute[74701]: </domain>
Oct 20 13:27:53 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1218930607',display_name='tempest-SnapshotDataIntegrityTests-server-1218930607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1218930607',id=41,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbOgqjx4wE5zdCA8D8SNYrvkIaHh0BO6F5lxURDU+9rTOWTbnsBPzVSpfLXMN+PSFixKjd8+y/RlQbrKuYQw6xROp2XrTkDFSqEVWceB5HBt/awA2UEk284GsqrcZLFwQ==',key_name='tempest-keypair-824515255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70909b4823c741d3ba1a2b94d14a8b20',ramdisk_id='',reservation_id='r-mn9up78l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-224030944',owner_user_name='tempest-SnapshotDataIntegrityTests-224030944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c511a58dbf04969819db3f49cadf236',uuid=f6eae62d-6deb-4ed4-bc20-b1d6e59fca90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converting VIF {"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG os_vif [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f456450-4c5f-5d71-a0ff-7ab10b914426', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e70767-0b, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e70767-0b, col_values=(('qos', UUID('4e445520-4dde-457f-8e93-f66598ffc7ce')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e70767-0b, col_values=(('external_ids', {'iface-id': '90e70767-0b33-4938-a5b0-28b4bc5a94ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:78:65', 'vm-uuid': 'f6eae62d-6deb-4ed4-bc20-b1d6e59fca90'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:53 user nova-compute[74701]: INFO os_vif [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b')
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No VIF found with MAC fa:16:3e:c1:78:65, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:27:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Instance spawned successfully.
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:53 user nova-compute[74701]: INFO nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:27:53 user nova-compute[74701]: INFO nova.compute.manager [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Took 6.24 seconds to build instance.
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] No waiting events found dispatching network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:53 user nova-compute[74701]: WARNING nova.compute.manager [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received unexpected event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d for instance with vm_state active and task_state None.
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-changed-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Refreshing instance network info cache due to event network-changed-90e70767-0b33-4938-a5b0-28b4bc5a94ff. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Acquiring lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Acquired lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Refreshing network info cache for port 90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:27:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-003facd4-c3c2-44df-87d3-e1301dbeb6a6 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.422s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updated VIF entry in instance network info cache for port 90e70767-0b33-4938-a5b0-28b4bc5a94ff. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01bff9d8-009e-4de0-a6cd-4639f7d3f893 req-ce3eecaa-1193-4f57-bb4f-16480a0ee0b8 service nova] Releasing lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] No waiting events found dispatching network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:54 user nova-compute[74701]: WARNING nova.compute.manager [req-15ba36cd-8338-4954-9f65-65b104691899 req-57bad013-d73b-4592-a436-6e228399bcb3 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received unexpected event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff for instance with vm_state building and task_state spawning.
Oct 20 13:27:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] No waiting events found dispatching network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:27:57 user nova-compute[74701]: WARNING nova.compute.manager [req-a5434f02-cf04-4ca2-bac7-945a4efee10f req-ac71593d-aee0-42e6-b4ac-b048c57c11b6 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received unexpected event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff for instance with vm_state building and task_state spawning.
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:27:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Instance spawned successfully.
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:27:57 user nova-compute[74701]: INFO nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Took 6.24 seconds to spawn the instance on the hypervisor.
Oct 20 13:27:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:27:57 user nova-compute[74701]: INFO nova.compute.manager [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Took 7.11 seconds to build instance.
Oct 20 13:27:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-bc8de58e-6061-46a2-8ea0-141a4b959aaf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.217s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:27:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing instance network info cache due to event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] Acquiring lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] Acquired lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing network info cache for port 98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updated VIF entry in instance network info cache for port 98cbbebf-6655-4498-88b0-5d4bc2905883. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [{"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bfc332b8-451c-40d6-9eac-816548c2813c req-d77cf0f4-6550-4d2a-aaa5-080f8dc9e316 service nova] Releasing lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:27:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:00 user nova-compute[74701]: INFO nova.compute.manager [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Attaching volume cc253f2b-8946-4c33-b514-edab5a76161f to /dev/vdb
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.utils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aee3b66-f677-4540-a9a9-705f491a92cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec14e7-841c-40fa-aaad-6bc0802f629b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[941fc9e1-b894-4077-ac7c-09bfaa0edf20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bcfdae-a509-48a6-82a6-21a8068392ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:28:00 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:28:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f543df6-dd78-44e7-86d4-54dc3ec88cad]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG os_brick.utils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:00 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating existing volume attachment record: d4e4e160-54e3-47dd-87ac-351035d48087 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:28:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:07 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:28:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=24.69186782836914GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:28:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 9dbb5296-c900-469d-8402-892639ec49ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 69aa6501-6507-4322-9010-05a2004fed89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b654cfe2-500f-4ffb-85c3-8bc19631984c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:28:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updating instance_info_cache with network_info: [{"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-611fd7ef-e138-4a36-b1ab-5d948038429a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:28:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCaBzJuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:23 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:23 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37df016-8f37-4f8b-8539-a03ce302c15b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:28:23 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4662cb78-4c3c-4e34-9b53-728a5faa4364]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f] added
Oct 20 13:28:23 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42da9d34-ec92-44dc-a987-2a465b74e6a5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909f41d-75a1-4b98-8063-673b258b811e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCaBzJuF {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCaBzJuF" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fd8f87-4837-483c-b98c-d838beea5a7d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCaBzJuF'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ecb19-40a5-43f9-bd6a-ae8ac2371d0c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[da725c72-d2cf-405f-8a9f-b32717d90edc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c72060-5ca2-4ff0-b4b5-b99ba37a6dc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260]
Oct 20 13:28:24 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260] successful.
Oct 20 13:28:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe4a43f-2c80-4e5d-9e8e-b7857017cd37]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df6ad6-c80b-4f5b-9dd2-adb8a84f581e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:24 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8aad94-59c0-4e7a-a1c1-f1d266fe79bc]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:28:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCaBzJuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23534343764346463', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534343764346463', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:28:25 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:28:25 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:28:25 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:28:25 user nova-compute[74701]:   <serial>cc253f2b-8946-4c33-b514-edab5a76161f</serial>
Oct 20 13:28:25 user nova-compute[74701]: </disk>
Oct 20 13:28:25 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] No VIF found with MAC fa:16:3e:ca:4d:e9, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:28:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0bfb962c-f11d-4d8f-b6d0-3b4cb5aceab6 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.465s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:27 user nova-compute[74701]: INFO nova.compute.manager [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Detaching volume cc253f2b-8946-4c33-b514-edab5a76161f
Oct 20 13:28:27 user nova-compute[74701]: INFO nova.virt.block_device [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Attempting to driver detach volume cc253f2b-8946-4c33-b514-edab5a76161f from mountpoint /dev/vdb
Oct 20 13:28:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Attempting to detach device vdb from instance 69aa6501-6507-4322-9010-05a2004fed89 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:28:27 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:28:27 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:28:27 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:28:27 user nova-compute[74701]:   <serial>cc253f2b-8946-4c33-b514-edab5a76161f</serial>
Oct 20 13:28:27 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:28:27 user nova-compute[74701]: </disk>
Oct 20 13:28:27 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:28:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully detached device vdb from instance 69aa6501-6507-4322-9010-05a2004fed89 from the persistent domain config.
Oct 20 13:28:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69aa6501-6507-4322-9010-05a2004fed89 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:28:27 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:28:27 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:28:27 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:28:27 user nova-compute[74701]:   <serial>cc253f2b-8946-4c33-b514-edab5a76161f</serial>
Oct 20 13:28:27 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:28:27 user nova-compute[74701]: </disk>
Oct 20 13:28:27 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:28:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:28:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:28:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:44 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:28:44 user nova-compute[74701]: INFO nova.compute.claims [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Claim successful on node user
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:45 user nova-compute[74701]: INFO nova.compute.manager [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Terminating instance
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:28:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-08e0f270-50c3-42ea-a5a1-8ee519444e61 req-4f8eb487-8d23-4a29-8444-152767003f3a service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-unplugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.policy [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52b23e0648e74a0ebdf77a03d4fe9483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81e60db14814ef8b68dda080fba920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:28:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Creating image(s)
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "/opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "/opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "/opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:45 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Instance destroyed successfully.
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 9dbb5296-c900-469d-8402-892639ec49ea {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601830016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601830016',id=34,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-7tqht7zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:26:59Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=9dbb5296-c900-469d-8402-892639ec49ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:28:45 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ca30b384-8335-4b08-87c7-2b817067acb5", "address": "fa:16:3e:af:da:e8", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca30b384-83", "ovs_interfaceid": "ca30b384-8335-4b08-87c7-2b817067acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_vif [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca30b384-83, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.198s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af00c426-82ae-43aa-aa35-f5550a54d020) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk 1073741824" returned: 0 in 0.058s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:46 user nova-compute[74701]: INFO os_vif [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca30b384-8335-4b08-87c7-2b817067acb5,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca30b384-83')
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnOAWmML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:46 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27830f86-2f09-434d-90a8-d1d55689afdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:28:46 user nova-compute[74701]: No targets found.
Oct 20 13:28:46 user nova-compute[74701]: iSNS:
Oct 20 13:28:46 user nova-compute[74701]: No targets found.
Oct 20 13:28:46 user nova-compute[74701]: STATIC:
Oct 20 13:28:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:28:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:28:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f
Oct 20 13:28:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb
Oct 20 13:28:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:28:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:46 user nova-compute[74701]: FIRMWARE:
Oct 20 13:28:46 user nova-compute[74701]: No targets found.
Oct 20 13:28:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:28:46 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:28:46 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278b59e-7f7c-425d-8a24-e5c7bf80e7d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f3214-22bf-458d-8d92-ded70fe67011]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:46 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e07349d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[844719f9-3712-4525-8e1a-0ddacde6ccc1]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Successfully created port: 1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7b6ba-893e-441f-a402-8e206902dae8]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddc427-7611-45d0-abbc-9ba739f3704f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98176827-b023-41a6-bfbb-1f7b15be84b9]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4875fa54-e63c-49cf-8dc2-e4328fd4cf0d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Cannot resize image /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Ensure instance console log exists: /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b49b33-f653-4a81-b2d4-abec556ec377]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260]
Oct 20 13:28:46 user nova-compute[74701]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb, portal: 172.16.0.220,3260] successful.
Oct 20 13:28:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b52204-24ee-48ef-ab1c-6b0c666dc7bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e602d3a-2aae-40d7-8e86-7116ebd53ae0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== disconnect_volume: return (440ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:28:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Deleting instance files /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea_del
Oct 20 13:28:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Deletion of /opt/stack/data/nova/instances/9dbb5296-c900-469d-8402-892639ec49ea_del complete
Oct 20 13:28:46 user nova-compute[74701]: INFO nova.compute.manager [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Took 1.49 seconds to destroy the instance on the hypervisor.
Oct 20 13:28:46 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:28:46 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:28:47 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Took 0.42 seconds to deallocate network for instance.
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-5445e252-ecb7-4d46-ae05-bbb8f1661cbd req-27976373-ee29-42f0-a1d8-48ac87047b0e service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-deleted-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Successfully updated port: 1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquired lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-changed-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Refreshing instance network info cache due to event network-changed-1d965f32-bbff-4bb7-b372-91189ee8d027. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] Acquiring lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'info_cache' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] Acquiring lock "9dbb5296-c900-469d-8402-892639ec49ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] Lock "9dbb5296-c900-469d-8402-892639ec49ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] No waiting events found dispatching network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:47 user nova-compute[74701]: WARNING nova.compute.manager [req-d733a917-7463-42d0-b068-05bedab45823 req-6a0f7929-3795-4ad8-ac04-027c4893dc27 service nova] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Received unexpected event network-vif-plugged-ca30b384-8335-4b08-87c7-2b817067acb5 for instance with vm_state active and task_state deleting.
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating instance_info_cache with network_info: [{"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Releasing lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Instance network_info: |[{"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] Acquired lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Refreshing network info cache for port 1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Start _get_guest_xml network_info=[{"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:28:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1271648214',display_name='tempest-VolumesSnapshotTestJSON-instance-1271648214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1271648214',id=42,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+/cnKeyhPCgxB8eidxdlqbwGhfmj5RYK4ETfVLxoUVOV3AB/NpsKw9SnqVIQDI04ehkPFirBF5ZNkXDrTlORZlrbQ6RbQz9fCsxUo+no+xolkrenOC4lf/RgOHEjv/IA==',key_name='tempest-keypair-663477142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-7vzh7ix2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=d05dfc01-7ac1-4711-9092-a4d6e6a7eadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'pci_devices' on Instance uuid d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:28:47 user nova-compute[74701]:   <uuid>d05dfc01-7ac1-4711-9092-a4d6e6a7eadc</uuid>
Oct 20 13:28:47 user nova-compute[74701]:   <name>instance-0000002a</name>
Oct 20 13:28:47 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:28:47 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:28:47 user nova-compute[74701]:   <metadata>
Oct 20 13:28:47 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:28:47 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1271648214</nova:name>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:28:47</nova:creationTime>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:28:47 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:28:47 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:owner>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:user uuid="52b23e0648e74a0ebdf77a03d4fe9483">tempest-VolumesSnapshotTestJSON-2076407407-project-member</nova:user>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:project uuid="f81e60db14814ef8b68dda080fba920e">tempest-VolumesSnapshotTestJSON-2076407407</nova:project>
Oct 20 13:28:47 user nova-compute[74701]:       </nova:owner>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:28:47 user nova-compute[74701]:       <nova:ports>
Oct 20 13:28:47 user nova-compute[74701]:         <nova:port uuid="1d965f32-bbff-4bb7-b372-91189ee8d027">
Oct 20 13:28:47 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 13:28:47 user nova-compute[74701]:         </nova:port>
Oct 20 13:28:47 user nova-compute[74701]:       </nova:ports>
Oct 20 13:28:47 user nova-compute[74701]:     </nova:instance>
Oct 20 13:28:47 user nova-compute[74701]:   </metadata>
Oct 20 13:28:47 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:28:47 user nova-compute[74701]:     <system>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="serial">d05dfc01-7ac1-4711-9092-a4d6e6a7eadc</entry>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="uuid">d05dfc01-7ac1-4711-9092-a4d6e6a7eadc</entry>
Oct 20 13:28:47 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:28:47 user nova-compute[74701]:     </system>
Oct 20 13:28:47 user nova-compute[74701]:   </sysinfo>
Oct 20 13:28:47 user nova-compute[74701]:   <os>
Oct 20 13:28:47 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:28:47 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:28:47 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:28:47 user nova-compute[74701]:   </os>
Oct 20 13:28:47 user nova-compute[74701]:   <features>
Oct 20 13:28:47 user nova-compute[74701]:     <acpi/>
Oct 20 13:28:47 user nova-compute[74701]:     <apic/>
Oct 20 13:28:47 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:28:47 user nova-compute[74701]:   </features>
Oct 20 13:28:47 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:28:47 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:28:47 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:28:47 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:28:47 user nova-compute[74701]:   </clock>
Oct 20 13:28:47 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:28:47 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:28:47 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:28:47 user nova-compute[74701]:   </cpu>
Oct 20 13:28:47 user nova-compute[74701]:   <devices>
Oct 20 13:28:47 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:28:47 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:28:47 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk"/>
Oct 20 13:28:47 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:28:47 user nova-compute[74701]:     </disk>
Oct 20 13:28:47 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:28:47 user nova-compute[74701]:       <mac address="fa:16:3e:f4:ab:18"/>
Oct 20 13:28:47 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:28:47 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:28:47 user nova-compute[74701]:       <target dev="tap1d965f32-bb"/>
Oct 20 13:28:47 user nova-compute[74701]:     </interface>
Oct 20 13:28:47 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:28:47 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/console.log" append="off"/>
Oct 20 13:28:47 user nova-compute[74701]:     </serial>
Oct 20 13:28:47 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:28:47 user nova-compute[74701]:     <video>
Oct 20 13:28:47 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:28:47 user nova-compute[74701]:     </video>
Oct 20 13:28:47 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:28:47 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:28:47 user nova-compute[74701]:     </rng>
Oct 20 13:28:47 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:28:47 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:28:47 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:28:47 user nova-compute[74701]:     </memballoon>
Oct 20 13:28:47 user nova-compute[74701]:   </devices>
Oct 20 13:28:47 user nova-compute[74701]: </domain>
Oct 20 13:28:47 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1271648214',display_name='tempest-VolumesSnapshotTestJSON-instance-1271648214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1271648214',id=42,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+/cnKeyhPCgxB8eidxdlqbwGhfmj5RYK4ETfVLxoUVOV3AB/NpsKw9SnqVIQDI04ehkPFirBF5ZNkXDrTlORZlrbQ6RbQz9fCsxUo+no+xolkrenOC4lf/RgOHEjv/IA==',key_name='tempest-keypair-663477142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-7vzh7ix2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=d05dfc01-7ac1-4711-9092-a4d6e6a7eadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_vif [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ccf8a0e-4e45-5dd3-9f17-b03d52d3a941', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d965f32-bb, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d965f32-bb, col_values=(('qos', UUID('42b7b104-83e6-434c-8fee-264539cfa9d3')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d965f32-bb, col_values=(('external_ids', {'iface-id': '1d965f32-bbff-4bb7-b372-91189ee8d027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ab:18', 'vm-uuid': 'd05dfc01-7ac1-4711-9092-a4d6e6a7eadc'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:47 user nova-compute[74701]: INFO os_vif [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb')
Oct 20 13:28:47 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69aa6501-6507-4322-9010-05a2004fed89 is timed out.
Oct 20 13:28:47 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully detached device vdb from instance 69aa6501-6507-4322-9010-05a2004fed89 from the live domain config.
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No VIF found with MAC fa:16:3e:f4:ab:18, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCaBzJuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe85e73-515e-4a9b-b4de-8497c1081590]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:28:47 user nova-compute[74701]: No targets found.
Oct 20 13:28:47 user nova-compute[74701]: iSNS:
Oct 20 13:28:47 user nova-compute[74701]: No targets found.
Oct 20 13:28:47 user nova-compute[74701]: STATIC:
Oct 20 13:28:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:28:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:28:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f
Oct 20 13:28:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:28:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:47 user nova-compute[74701]: FIRMWARE:
Oct 20 13:28:47 user nova-compute[74701]: No targets found.
Oct 20 13:28:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:28:47 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:28:47 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:47 user nova-compute[74701]: DEBUG nova.network.neutron [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:28:48 user nova-compute[74701]: INFO nova.compute.manager [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 9dbb5296-c900-469d-8402-892639ec49ea] Took 0.92 seconds to detach 1 volumes for instance.
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dcbd01-a010-4f4a-baf3-9383a8e5353c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7397d-1f52-410e-b285-8866cfaba10a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f (non-flash)
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e011f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance destroyed successfully.
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'resources' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a76fb-7baa-4567-8c4d-c22f31100d07]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc61d81-ae, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791fa78-8d59-4f97-9144-4d907f9a42e8]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e48a8e-2bea-42ab-be39-cc59d08a284c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.network.neutron [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updated VIF entry in instance network info cache for port 1d965f32-bbff-4bb7-b372-91189ee8d027. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.network.neutron [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating instance_info_cache with network_info: [{"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14ccccde-2c16-4031-8075-0c8807d437a4) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6540faa8-7a35-46f8-b855-054fd99dc530 req-24ae2e75-a06a-4c1f-b2fe-d61d1f3ddd74 service nova] Releasing lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:28:48 user nova-compute[74701]: INFO os_vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d970fb-fb43-4d96-a537-0b083fa7fb56]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ccd586-1caa-433e-a355-f5940a3d3db5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b872f363-1369-4933-9ed2-f146ffd94da8]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260]
Oct 20 13:28:48 user nova-compute[74701]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f, portal: 172.16.0.220,3260] successful.
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc253f2b-8946-4c33-b514-edab5a76161f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caacd99-85a4-4f2d-9326-2726ee545f69]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] <== disconnect_volume: return (427ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.140s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115a1e4-b04c-415a-87ae-de8e917a7345]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:28:48 user nova-compute[74701]: No targets found.
Oct 20 13:28:48 user nova-compute[74701]: iSNS:
Oct 20 13:28:48 user nova-compute[74701]: No targets found.
Oct 20 13:28:48 user nova-compute[74701]: STATIC:
Oct 20 13:28:48 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:28:48 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:48 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:48 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:28:48 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:48 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:48 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:28:48 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:28:48 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:28:48 user nova-compute[74701]: FIRMWARE:
Oct 20 13:28:48 user nova-compute[74701]: No targets found.
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:28:48 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:28:48 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59edd82-e77d-4f38-8a69-28534002c691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa0872f-9a56-4ea3-96ef-3545f4c1c8e3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:48 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f87000fe710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c'): ({'sde'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Removing single pathed devices sde {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3a1ebf-2707-4840-8325-e4ab87170770]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0594debd-b3b5-4eb3-8ae3-0f12814491ae]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flushing IO for device /dev/sde {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bbe90-9c2a-4221-ad51-d0a38d38b334]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[024b2bf6-37a5-4921-97b9-f3b34f268913]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a46f6-b623-4b2c-8e8f-d862ae8805cc]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd6b9d-4b25-49ca-89f8-284a7e60af59]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]
Oct 20 13:28:48 user nova-compute[74701]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1fbd1-c536-4cc0-a7dd-95115e4b636c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== disconnect_volume: return (475ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start _get_guest_xml network_info=[{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8e32bfa5-4d85-409b-95f7-05f8bab18414', 'attached_at': '', 'detached_at': '', 'volume_id': 'd42c4367-71c5-489b-a55a-8db2367be42c', 'serial': 'd42c4367-71c5-489b-a55a-8db2367be42c'}, 'attachment_id': 'cfd70040-7c22-4f03-acd0-da2fff75ffd6', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:48 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Deleted allocations for instance 9dbb5296-c900-469d-8402-892639ec49ea
Oct 20 13:28:48 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:48 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:28:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:48 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:28:48 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a39e0d-854f-4db8-ab7f-dd61c9b9625d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:28:48 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a2f9f12c-30ba-4856-a74e-d6b8929e1e09 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "9dbb5296-c900-469d-8402-892639ec49ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.772s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc1952-dee4-4779-9a1b-7aefc6c69366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c] added
Oct 20 13:28:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f09b87-3dd0-4698-928d-4b408ede4fcc]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0146f795-bdea-4fba-b568-387af7e0de04]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkVCquhR {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkVCquhR" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[41317fbf-3dbd-4018-b8d9-8eb5aa67a6f3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkVCquhR'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cc38f4-87e5-428c-b0f4-d737697a720d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853f4c3-6725-43f2-9b99-2d163f3bbb54]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4001a257-a7cc-4d5c-b767-e5e4b19ac039]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]
Oct 20 13:28:49 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.
Oct 20 13:28:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff66c73-6a80-4f86-875b-ffbd6c3368aa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48475ab-3903-413d-abe7-683811eebf19]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:28:49 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:28:49 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958dfb1-c411-44e4-84a5-afc44a4d5216]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'flavor' on Instance uuid 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8275f65a-c332-4ac0-ad71-41f4fe53d0ad tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.007s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG nova.compute.manager [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] No waiting events found dispatching network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:49 user nova-compute[74701]: WARNING nova.compute.manager [req-03b147de-ab82-4688-ae75-cb81ad7bb0f4 req-1edac009-cc00-409a-ae25-4908d3cb639b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received unexpected event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 for instance with vm_state building and task_state spawning.
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23638363839633666', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638363839633666', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:28:50 user nova-compute[74701]:   <uuid>8e32bfa5-4d85-409b-95f7-05f8bab18414</uuid>
Oct 20 13:28:50 user nova-compute[74701]:   <name>instance-00000025</name>
Oct 20 13:28:50 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:28:50 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:28:50 user nova-compute[74701]:   <metadata>
Oct 20 13:28:50 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:28:50 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeTestJSON-server-1501582274</nova:name>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:28:48</nova:creationTime>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:28:50 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:28:50 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:owner>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:user uuid="037a86ef21bf4b58874c1ce851f51ae6">tempest-AttachVolumeTestJSON-117323651-project-member</nova:user>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:project uuid="2eef02ee91884642a3c6612d54890923">tempest-AttachVolumeTestJSON-117323651</nova:project>
Oct 20 13:28:50 user nova-compute[74701]:       </nova:owner>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:28:50 user nova-compute[74701]:       <nova:ports>
Oct 20 13:28:50 user nova-compute[74701]:         <nova:port uuid="7bc61d81-aed3-4a1d-8243-1affa2da3280">
Oct 20 13:28:50 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:28:50 user nova-compute[74701]:         </nova:port>
Oct 20 13:28:50 user nova-compute[74701]:       </nova:ports>
Oct 20 13:28:50 user nova-compute[74701]:     </nova:instance>
Oct 20 13:28:50 user nova-compute[74701]:   </metadata>
Oct 20 13:28:50 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:28:50 user nova-compute[74701]:     <system>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="serial">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="uuid">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:28:50 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:28:50 user nova-compute[74701]:     </system>
Oct 20 13:28:50 user nova-compute[74701]:   </sysinfo>
Oct 20 13:28:50 user nova-compute[74701]:   <os>
Oct 20 13:28:50 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:28:50 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:28:50 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:28:50 user nova-compute[74701]:   </os>
Oct 20 13:28:50 user nova-compute[74701]:   <features>
Oct 20 13:28:50 user nova-compute[74701]:     <acpi/>
Oct 20 13:28:50 user nova-compute[74701]:     <apic/>
Oct 20 13:28:50 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:28:50 user nova-compute[74701]:   </features>
Oct 20 13:28:50 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:28:50 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:28:50 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:28:50 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:28:50 user nova-compute[74701]:   </clock>
Oct 20 13:28:50 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:28:50 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:28:50 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:28:50 user nova-compute[74701]:   </cpu>
Oct 20 13:28:50 user nova-compute[74701]:   <devices>
Oct 20 13:28:50 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:28:50 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:28:50 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk"/>
Oct 20 13:28:50 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:28:50 user nova-compute[74701]:     </disk>
Oct 20 13:28:50 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:28:50 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:28:50 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:28:50 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:28:50 user nova-compute[74701]:       <serial>d42c4367-71c5-489b-a55a-8db2367be42c</serial>
Oct 20 13:28:50 user nova-compute[74701]:     </disk>
Oct 20 13:28:50 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:28:50 user nova-compute[74701]:       <mac address="fa:16:3e:f5:d0:67"/>
Oct 20 13:28:50 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:28:50 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:28:50 user nova-compute[74701]:       <target dev="tap7bc61d81-ae"/>
Oct 20 13:28:50 user nova-compute[74701]:     </interface>
Oct 20 13:28:50 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:28:50 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/console.log" append="off"/>
Oct 20 13:28:50 user nova-compute[74701]:     </serial>
Oct 20 13:28:50 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:28:50 user nova-compute[74701]:     <video>
Oct 20 13:28:50 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:28:50 user nova-compute[74701]:     </video>
Oct 20 13:28:50 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:28:50 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:28:50 user nova-compute[74701]:     </rng>
Oct 20 13:28:50 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:28:50 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:28:50 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:28:50 user nova-compute[74701]:     </memballoon>
Oct 20 13:28:50 user nova-compute[74701]:   </devices>
Oct 20 13:28:50 user nova-compute[74701]: </domain>
Oct 20 13:28:50 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Cannot resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:28:50 user nova-compute[74701]: DEBUG nova.objects.instance [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'migration_context' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.objects.base [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG os_vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b05c3f81-abb8-524b-bdef-d0af116c90a2', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc61d81-ae, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bc61d81-ae, col_values=(('qos', UUID('13351498-3175-4184-9ee7-9f27b8564b2e')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bc61d81-ae, col_values=(('external_ids', {'iface-id': '7bc61d81-aed3-4a1d-8243-1affa2da3280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d0:67', 'vm-uuid': '8e32bfa5-4d85-409b-95f7-05f8bab18414'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:51 user nova-compute[74701]: INFO os_vif [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:28:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Instance spawned successfully.
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:28:51 user nova-compute[74701]: INFO nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] No waiting events found dispatching network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:51 user nova-compute[74701]: WARNING nova.compute.manager [req-57e32591-04d9-4d7d-aae9-a600f7ea4489 req-2f001831-0640-49b1-9479-fd0d1a59301b service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received unexpected event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 for instance with vm_state building and task_state spawning.
Oct 20 13:28:51 user nova-compute[74701]: INFO nova.compute.manager [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Took 6.77 seconds to build instance.
Oct 20 13:28:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-47c19ed5-baa7-4144-ae3a-a5b041bf3387 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.862s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:53 user nova-compute[74701]: WARNING nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state stopped and task_state powering-on.
Oct 20 13:28:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:28:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:28:53 user nova-compute[74701]: WARNING nova.compute.manager [req-16bb6fbd-fc7a-41f3-a139-fae994479e87 req-62d1df49-be21-4a8f-b646-77b9d568e522 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state stopped and task_state powering-on.
Oct 20 13:28:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:28:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance rebooted successfully.
Oct 20 13:28:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-23181259-f8f1-4437-81a6-a8233a7c80b4 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:28:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:28:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing instance network info cache due to event network-changed-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Refreshing network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated VIF entry in instance network info cache for port fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-815fefa6-2116-4866-8024-c799ca82ed63 req-260a230b-dccb-4277-bfd9-114c52fe0910 service nova] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:29:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG nova.compute.manager [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Stashing vm_state: active {{(pid=74701) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:29:09 user nova-compute[74701]: INFO nova.compute.claims [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Claim successful on node user
Oct 20 13:29:09 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating resource usage from migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-changed-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.compute.manager [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Refreshing instance network info cache due to event network-changed-ed74ca21-24c2-4479-8d07-971fc22f3b29. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Refreshing network info cache for port ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.579s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:10 user nova-compute[74701]: INFO nova.compute.manager [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Migrating
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updated VIF entry in instance network info cache for port ed74ca21-24c2-4479-8d07-971fc22f3b29. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c6c37df6-b05c-4e06-af20-c11f08b8a5ee req-48f3c0ff-b72b-4c8f-8b6b-2149ebee6eab service nova] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Starting migrate_disk_and_power_off {{(pid=74701) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance destroyed successfully.
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped74ca21-24, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=098c0702-3ad2-4405-9083-8c2a0b8ae3eb) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:12 user nova-compute[74701]: INFO os_vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24')
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:29:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a23595-460e-4fb2-8977-622c11cf78be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:29:12 user nova-compute[74701]: No targets found.
Oct 20 13:29:12 user nova-compute[74701]: iSNS:
Oct 20 13:29:12 user nova-compute[74701]: No targets found.
Oct 20 13:29:12 user nova-compute[74701]: STATIC:
Oct 20 13:29:12 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:29:12 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:29:12 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:29:12 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:29:12 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:29:12 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:29:12 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:29:12 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:29:12 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:29:12 user nova-compute[74701]: FIRMWARE:
Oct 20 13:29:12 user nova-compute[74701]: No targets found.
Oct 20 13:29:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:29:12 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:29:12 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798f525-d2dc-4fba-b185-ba9a4bfd4b04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca4cc93-fdad-4976-8fa2-8c8ef8096431]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:12 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:29:12 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:12 user nova-compute[74701]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:29:12 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0188310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd'): ({'sdf'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Removing single pathed devices sdf {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:12 user nova-compute[74701]: WARNING nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state active and task_state resize_migrating.
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:12 user nova-compute[74701]: WARNING nova.compute.manager [req-847cb8af-6e2a-451b-a5cc-99491164a449 req-26d00add-8d9d-4fc0-91dd-976c1ef6c3d7 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state active and task_state resize_migrating.
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f209fef-24aa-431f-b9b8-508cc088b07c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd7b96c-cebc-4527-b3be-e1a9376f112f]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flushing IO for device /dev/sdf {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f292fa-3f7f-4c09-af7f-d6fc55a113b0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9f201-e9c7-4623-aa7c-8c855bdfa9a5]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d454d6b',) {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:29:12 user nova-compute[74701]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4d454d6b
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9b493-c713-4c1e-bc75-8891b90c7f41]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22542e-855a-4fc5-9ddf-b52ba1141778]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7492f5-23c6-4bc4-8c60-8f03c3bf010c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]
Oct 20 13:29:12 user nova-compute[74701]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.
Oct 20 13:29:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb2fd9-fae5-4b88-bbdf-d839ef7a3056]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== disconnect_volume: return (444ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:29:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:29:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7525MB free_disk=24.605350494384766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Applying migration context for instance 581e2c46-293f-40a8-90bc-44188395eaba as it has an incoming, in-progress migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187. Migration status is migrating {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 13:29:13 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating resource usage from migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 611fd7ef-e138-4a36-b1ab-5d948038429a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 69aa6501-6507-4322-9010-05a2004fed89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b654cfe2-500f-4ffb-85c3-8bc19631984c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:29:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Port ed74ca21-24c2-4479-8d07-971fc22f3b29 binding to destination host user is already ACTIVE {{(pid=74701) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.utils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7ad2f-f4a7-45e2-bd3c-58227dc8a880]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aea73b-6425-4d76-99d9-a1b3dbc2f334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61a397-c28c-4fe8-ac97-bfc250aa908a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b13b8e-e49a-42a2-8b70-b0501c899151]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:14 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:29:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9c1e5-3df9-4aec-be5b-bb988dbbc389]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:29:14 user nova-compute[74701]: DEBUG os_brick.utils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing instance network info cache due to event network-changed-98cbbebf-6655-4498-88b0-5d4bc2905883. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] Acquiring lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] Acquired lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.network.neutron [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Refreshing network info cache for port 98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:18 user nova-compute[74701]: INFO nova.compute.manager [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Terminating instance
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-unplugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] No waiting events found dispatching network-vif-unplugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-afa8221f-aad0-4d6b-8284-5b7ad535fe9c req-423555c9-79ef-422c-99b7-d0c736d97f3a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-unplugged-98cbbebf-6655-4498-88b0-5d4bc2905883 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.network.neutron [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updated VIF entry in instance network info cache for port 98cbbebf-6655-4498-88b0-5d4bc2905883. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.network.neutron [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [{"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a24accdd-5659-4075-8e09-7d41c88a9720 req-9d2a8855-ec5e-4d77-ac66-bf9967f29655 service nova] Releasing lock "refresh_cache-69aa6501-6507-4322-9010-05a2004fed89" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Instance destroyed successfully.
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'resources' on Instance uuid 69aa6501-6507-4322-9010-05a2004fed89 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-882414009',display_name='tempest-TestStampPattern-server-882414009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-882414009',id=38,image_ref='e6ff2385-83f6-45ac-b50d-fa684d20e477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:26:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-h0gni6cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f5fa149e-2c53-42c6-8582-8dc13ea18857',image_min_disk='1',image_min_ram='0',image_owner_id='04d12fee426e4728a322fc03e1f2d506',image_owner_project_name='tempest-TestStampPattern-1055047061',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055047061-project-member',image_user_id='819014923a4d471fa9a109ba59da3ed5',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:26:17Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=69aa6501-6507-4322-9010-05a2004fed89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "98cbbebf-6655-4498-88b0-5d4bc2905883", "address": "fa:16:3e:ca:4d:e9", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cbbebf-66", "ovs_interfaceid": "98cbbebf-6655-4498-88b0-5d4bc2905883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG os_vif [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cbbebf-66, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f87fa771-0062-4933-9a5a-e050301221b4) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:19 user nova-compute[74701]: INFO os_vif [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4d:e9,bridge_name='br-int',has_traffic_filtering=True,id=98cbbebf-6655-4498-88b0-5d4bc2905883,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cbbebf-66')
Oct 20 13:29:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Deleting instance files /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89_del
Oct 20 13:29:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Deletion of /opt/stack/data/nova/instances/69aa6501-6507-4322-9010-05a2004fed89_del complete
Oct 20 13:29:19 user nova-compute[74701]: INFO nova.compute.manager [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 13:29:19 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:19 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Took 0.60 seconds to deallocate network for instance.
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-0e18a625-daf6-4d52-b8e8-ffbfc35d23d1 req-8e2e78b3-79da-42cb-80d7-c22ecf243bb6 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-deleted-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:19 user nova-compute[74701]: INFO nova.compute.manager [req-0e18a625-daf6-4d52-b8e8-ffbfc35d23d1 req-8e2e78b3-79da-42cb-80d7-c22ecf243bb6 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Neutron deleted interface 98cbbebf-6655-4498-88b0-5d4bc2905883; detaching it from the instance and deleting it from the info cache
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.network.neutron [req-0e18a625-daf6-4d52-b8e8-ffbfc35d23d1 req-8e2e78b3-79da-42cb-80d7-c22ecf243bb6 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-0e18a625-daf6-4d52-b8e8-ffbfc35d23d1 req-8e2e78b3-79da-42cb-80d7-c22ecf243bb6 service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Detach interface failed, port_id=98cbbebf-6655-4498-88b0-5d4bc2905883, reason: Instance 69aa6501-6507-4322-9010-05a2004fed89 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:20 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Deleted allocations for instance 69aa6501-6507-4322-9010-05a2004fed89
Oct 20 13:29:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b8f580ca-d04d-4992-bf3d-fbe660498022 tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "69aa6501-6507-4322-9010-05a2004fed89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] Acquiring lock "69aa6501-6507-4322-9010-05a2004fed89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] Lock "69aa6501-6507-4322-9010-05a2004fed89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] No waiting events found dispatching network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:20 user nova-compute[74701]: WARNING nova.compute.manager [req-ebbb0d57-382e-4b84-a806-64d87f24e986 req-4d7de12b-4396-45a1-b0ea-0c56c51c206a service nova] [instance: 69aa6501-6507-4322-9010-05a2004fed89] Received unexpected event network-vif-plugged-98cbbebf-6655-4498-88b0-5d4bc2905883 for instance with vm_state deleted and task_state None.
Oct 20 13:29:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:25 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:29:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Starting finish_migration {{(pid=74701) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance directory exists: not creating {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 13:29:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Creating image(s)
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Ensure instance console log exists: /opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start _get_guest_xml network_info=[{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '581e2c46-293f-40a8-90bc-44188395eaba', 'attached_at': '2023-10-20T13:29:32.000000', 'detached_at': '', 'volume_id': 'e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'serial': 'e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd'}, 'attachment_id': '7349e009-dc21-4f7b-92a8-671edebc213b', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:29:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:29:32 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:29:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:29:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:29:32 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbea9c-1643-495c-bfbe-36c6f46ec72f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:29:32 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1071f73a-9de7-4459-b10d-84fda838cedb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd] added
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e73dda-b3da-4b76-bec2-e33adb4faeaf]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3ea357-631c-4b1b-be2d-f322600e4bfa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTHUPWro {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTHUPWro" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0de802-c3dc-461b-a8ca-e86f23eb5ff2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTHUPWro'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26c306d-6116-494f-9363-edaf2219ed6b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9673f54-7da0-4118-aeb8-7e7c74a9491b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[023ced2c-b6b6-4b80-82d7-03cfc3419b47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]
Oct 20 13:29:32 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82672729-37f8-4162-be4c-99bbd512866d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f1a1ad-fadb-4fa1-a0e4-7e5469694e57]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:29:32 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:29:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5eee84-78c7-463b-8484-ccd128f1806d]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:29:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23264356239663233', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264356239663233', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:29:33 user nova-compute[74701]:   <uuid>581e2c46-293f-40a8-90bc-44188395eaba</uuid>
Oct 20 13:29:33 user nova-compute[74701]:   <name>instance-00000027</name>
Oct 20 13:29:33 user nova-compute[74701]:   <memory>2097152</memory>
Oct 20 13:29:33 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:29:33 user nova-compute[74701]:   <metadata>
Oct 20 13:29:33 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:29:33 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:29:33 user nova-compute[74701]:       <nova:name>tempest-ServerActionsTestOtherA-server-470408425</nova:name>
Oct 20 13:29:33 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:29:32</nova:creationTime>
Oct 20 13:29:33 user nova-compute[74701]:       <nova:flavor name="m1.small">
Oct 20 13:29:33 user nova-compute[74701]:         <nova:memory>2048</nova:memory>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:disk>20</nova:disk>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:29:33 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:29:33 user nova-compute[74701]:       <nova:owner>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:user uuid="9189507d4d4f4faeb52d1f6b1fcb17d8">tempest-ServerActionsTestOtherA-1694438458-project-member</nova:user>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:project uuid="0182e44f51fb425c8cd560e7a42da61f">tempest-ServerActionsTestOtherA-1694438458</nova:project>
Oct 20 13:29:33 user nova-compute[74701]:       </nova:owner>
Oct 20 13:29:33 user nova-compute[74701]:       <nova:ports>
Oct 20 13:29:33 user nova-compute[74701]:         <nova:port uuid="ed74ca21-24c2-4479-8d07-971fc22f3b29">
Oct 20 13:29:33 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:29:33 user nova-compute[74701]:         </nova:port>
Oct 20 13:29:33 user nova-compute[74701]:       </nova:ports>
Oct 20 13:29:33 user nova-compute[74701]:     </nova:instance>
Oct 20 13:29:33 user nova-compute[74701]:   </metadata>
Oct 20 13:29:33 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:29:33 user nova-compute[74701]:     <system>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="serial">581e2c46-293f-40a8-90bc-44188395eaba</entry>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="uuid">581e2c46-293f-40a8-90bc-44188395eaba</entry>
Oct 20 13:29:33 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:29:33 user nova-compute[74701]:     </system>
Oct 20 13:29:33 user nova-compute[74701]:   </sysinfo>
Oct 20 13:29:33 user nova-compute[74701]:   <os>
Oct 20 13:29:33 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:29:33 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:29:33 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:29:33 user nova-compute[74701]:   </os>
Oct 20 13:29:33 user nova-compute[74701]:   <features>
Oct 20 13:29:33 user nova-compute[74701]:     <acpi/>
Oct 20 13:29:33 user nova-compute[74701]:     <apic/>
Oct 20 13:29:33 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:29:33 user nova-compute[74701]:   </features>
Oct 20 13:29:33 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:29:33 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:29:33 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:29:33 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:29:33 user nova-compute[74701]:   </clock>
Oct 20 13:29:33 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:29:33 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:29:33 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:29:33 user nova-compute[74701]:   </cpu>
Oct 20 13:29:33 user nova-compute[74701]:   <devices>
Oct 20 13:29:33 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:29:33 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:29:33 user nova-compute[74701]:       <source dev="/dev/sdd"/>
Oct 20 13:29:33 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:29:33 user nova-compute[74701]:       <serial>e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd</serial>
Oct 20 13:29:33 user nova-compute[74701]:     </disk>
Oct 20 13:29:33 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:29:33 user nova-compute[74701]:       <mac address="fa:16:3e:bc:56:e6"/>
Oct 20 13:29:33 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:29:33 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:29:33 user nova-compute[74701]:       <target dev="taped74ca21-24"/>
Oct 20 13:29:33 user nova-compute[74701]:     </interface>
Oct 20 13:29:33 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:29:33 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba/console.log" append="off"/>
Oct 20 13:29:33 user nova-compute[74701]:     </serial>
Oct 20 13:29:33 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:29:33 user nova-compute[74701]:     <video>
Oct 20 13:29:33 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:29:33 user nova-compute[74701]:     </video>
Oct 20 13:29:33 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:29:33 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:29:33 user nova-compute[74701]:     </rng>
Oct 20 13:29:33 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:29:33 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:29:33 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:29:33 user nova-compute[74701]:     </memballoon>
Oct 20 13:29:33 user nova-compute[74701]:   </devices>
Oct 20 13:29:33 user nova-compute[74701]: </domain>
Oct 20 13:29:33 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-299887580-network", "vif_mac": "fa:16:3e:bc:56:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG os_vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '589d510b-dfa9-5ca3-bd0e-647b10f7c258', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped74ca21-24, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped74ca21-24, col_values=(('qos', UUID('272a5cbe-d8d3-44ca-8240-8ab527a637d7')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped74ca21-24, col_values=(('external_ids', {'iface-id': 'ed74ca21-24c2-4479-8d07-971fc22f3b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:56:e6', 'vm-uuid': '581e2c46-293f-40a8-90bc-44188395eaba'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:33 user nova-compute[74701]: INFO os_vif [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24')
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:29:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] No VIF found with MAC fa:16:3e:bc:56:e6, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:35 user nova-compute[74701]: WARNING nova.compute.manager [req-0057dcee-2a21-4c59-90b6-191815a88778 req-7fd061e5-d99b-4a1e-8740-52632477b457 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state active and task_state resize_finish.
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:36 user nova-compute[74701]: INFO nova.compute.manager [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Terminating instance
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-unplugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] No waiting events found dispatching network-vif-unplugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.compute.manager [req-b69f1765-a22e-4cbb-a8ac-fd2718dfff63 req-fd34fa6b-a855-4034-9ee9-fb362aba4a26 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-unplugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Instance destroyed successfully.
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 611fd7ef-e138-4a36-b1ab-5d948038429a {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281289606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281289606',id=31,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-0tg90v5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:22:10Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=611fd7ef-e138-4a36-b1ab-5d948038429a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "address": "fa:16:3e:ea:a0:96", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53350cf6-0d", "ovs_interfaceid": "53350cf6-0dbf-4a16-b794-601d3ca4d2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG os_vif [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53350cf6-0d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78ba3d85-7353-47d4-a088-9c0ed719efea) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:29:36 user nova-compute[74701]: INFO os_vif [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a0:96,bridge_name='br-int',has_traffic_filtering=True,id=53350cf6-0dbf-4a16-b794-601d3ca4d2b2,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53350cf6-0d')
Oct 20 13:29:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Deleting instance files /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a_del
Oct 20 13:29:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Deletion of /opt/stack/data/nova/instances/611fd7ef-e138-4a36-b1ab-5d948038429a_del complete
Oct 20 13:29:37 user nova-compute[74701]: INFO nova.compute.manager [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:29:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance running successfully.
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Failed to set time: agent not configured {{(pid=74701) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-88a23d68-a92b-4b11-8bb5-fc08cb235f91 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] finish_migration finished successfully. {{(pid=74701) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:37 user nova-compute[74701]: WARNING nova.compute.manager [req-8008b4dc-a169-4836-8318-9ac52e8758af req-6ab10dd1-f7dc-4934-aac4-7346eddb0f0d service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state active and task_state resize_finish.
Oct 20 13:29:37 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:37 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Took 0.56 seconds to deallocate network for instance.
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-changed-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG nova.compute.manager [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Refreshing instance network info cache due to event network-changed-ee475172-4f64-4d3d-984a-7ce01df9c49d. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] Acquiring lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] Acquired lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG nova.network.neutron [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Refreshing network info cache for port ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:29:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:38 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Deleted allocations for instance 611fd7ef-e138-4a36-b1ab-5d948038429a
Oct 20 13:29:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8c760f20-f452-4fc1-91fb-dee231a92f92 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.109s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] Acquiring lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] Lock "611fd7ef-e138-4a36-b1ab-5d948038429a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] No waiting events found dispatching network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:29:39 user nova-compute[74701]: WARNING nova.compute.manager [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received unexpected event network-vif-plugged-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 for instance with vm_state deleted and task_state None.
Oct 20 13:29:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-641adf04-9e69-496b-acef-7455cde78683 req-71e48a02-eb3d-48e5-997e-b260c7ea6236 service nova] [instance: 611fd7ef-e138-4a36-b1ab-5d948038429a] Received event network-vif-deleted-53350cf6-0dbf-4a16-b794-601d3ca4d2b2 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updated VIF entry in instance network info cache for port ee475172-4f64-4d3d-984a-7ce01df9c49d. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating instance_info_cache with network_info: [{"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8f45989b-6fb1-4130-b629-132ffb00873c req-fe731c69-7072-49ce-8b07-e35e9d7a12df service nova] Releasing lock "refresh_cache-b654cfe2-500f-4ffb-85c3-8bc19631984c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-changed-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Refreshing instance network info cache due to event network-changed-90e70767-0b33-4938-a5b0-28b4bc5a94ff. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] Acquiring lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] Acquired lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Refreshing network info cache for port 90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updated VIF entry in instance network info cache for port 90e70767-0b33-4938-a5b0-28b4bc5a94ff. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec34eb2c-238f-4e9e-b482-69cdd4147d06 req-64a5c345-0b8e-4c0f-a7b2-db767701deeb service nova] Releasing lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:29:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:44 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lazy-loading 'flavor' on Instance uuid b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:29:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:45 user nova-compute[74701]: INFO nova.compute.manager [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Attaching volume bfc636dd-99d5-4acf-8aee-62c5d06d9d10 to /dev/vdb
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.utils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62021288-796e-438f-ab72-ed7c782ab9af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b56593-9370-4acb-b041-fc88c33f2834]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3b731-7c1e-43bf-8b4a-d5e368d3014e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[89354b54-1f63-4dee-a4f9-161a69e77bd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:45 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:29:45 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f25d6b2-4240-45da-8b50-a441f4456727]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG os_brick.utils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:29:45 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating existing volume attachment record: 6d2f22da-a453-4ba6-9dfc-df1282f5dcd6 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:29:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG nova.objects.instance [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:29:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:29:48 user nova-compute[74701]: INFO nova.compute.manager [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attaching volume 2486d134-43a4-4fff-9ab2-ba5d8c0e5eef to /dev/vdb
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.utils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba5b63-dd74-4eeb-9cf1-6b1cad1515ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d529f6-405c-4305-8fd3-167a4059ba3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af4de7-662f-4a6e-b023-d7eb6f4d52b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3b233-86aa-433c-994c-3bacb8b1af53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:29:49 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:29:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df43c78-f6b6-47ff-83d0-a49716d0b068]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG os_brick.utils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:29:49 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating existing volume attachment record: 90088080-60f5-4294-876e-175c76fe8272 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:29:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:29:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQkxRETi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:03 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee1c60-3ef4-4fa4-be7c-b52989cd8d75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:30:03 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e147ff-38c6-422f-8279-99855cd5e674]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10] added
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dcaa37-9366-43ee-9bd0-e66f15f96e70]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f321186-d86f-444a-b1c8-324bc3fe50a2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQkxRETi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQkxRETi" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c2cde-57a8-41ac-ac35-f748283c4523]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CQkxRETi'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3becd8c6-9ff7-4494-8580-5fb051fd9148]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4d11c-8652-46a3-b0c3-996640dd3406]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff974e-5cea-4f89-9997-223ae7b918b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260]
Oct 20 13:30:03 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1723f9-25fd-431f-bcc8-0ea529865ade]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d45a76-d855-46c8-bfbc-e6dba0bf63dd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:03 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ddbf1e-a77c-4e93-bfb9-c2b7a1c9dfbe]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQkxRETi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23762356333353864', 'path': '/dev/sde'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762356333353864', 'path': '/dev/sde'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lazy-loading 'flavor' on Instance uuid b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:30:04 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:04 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:30:04 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:04 user nova-compute[74701]:   <serial>bfc636dd-99d5-4acf-8aee-62c5d06d9d10</serial>
Oct 20 13:30:04 user nova-compute[74701]: </disk>
Oct 20 13:30:04 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] No VIF found with MAC fa:16:3e:50:f8:51, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:30:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4f4e47b6-73a3-4a4a-b302-8868eb599999 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.888s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:06 user nova-compute[74701]: INFO nova.compute.manager [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Detaching volume bfc636dd-99d5-4acf-8aee-62c5d06d9d10
Oct 20 13:30:06 user nova-compute[74701]: INFO nova.virt.block_device [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Attempting to driver detach volume bfc636dd-99d5-4acf-8aee-62c5d06d9d10 from mountpoint /dev/vdb
Oct 20 13:30:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Attempting to detach device vdb from instance b654cfe2-500f-4ffb-85c3-8bc19631984c from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:06 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:06 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:30:06 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:06 user nova-compute[74701]:   <serial>bfc636dd-99d5-4acf-8aee-62c5d06d9d10</serial>
Oct 20 13:30:06 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:30:06 user nova-compute[74701]: </disk>
Oct 20 13:30:06 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Successfully detached device vdb from instance b654cfe2-500f-4ffb-85c3-8bc19631984c from the persistent domain config.
Oct 20 13:30:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b654cfe2-500f-4ffb-85c3-8bc19631984c from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:06 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:06 user nova-compute[74701]:   <source dev="/dev/sde"/>
Oct 20 13:30:06 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:06 user nova-compute[74701]:   <serial>bfc636dd-99d5-4acf-8aee-62c5d06d9d10</serial>
Oct 20 13:30:06 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:30:06 user nova-compute[74701]: </disk>
Oct 20 13:30:06 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:30:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:30:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyDCNgSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:11 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:11 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:11 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b449a-f97b-4314-be1e-3a4e4b78fa69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:30:11 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30022a-acb1-402c-b240-e7b84f8371e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef] added
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e116b2e1-ad24-407f-8b91-861c5751a7f3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be624b4-054f-4016-a6b7-f36547a8b81a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iyDCNgSq {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iyDCNgSq" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f809cd-89b6-45e2-8912-3295086d7673]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iyDCNgSq'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4c55f-4333-4e38-9fb8-bb1d33ccceaa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c2d81-4ea2-4999-ae2e-89ff255a533e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7040c-cb3b-4dca-bcb2-af26e33dd598]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260]
Oct 20 13:30:11 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17a89f-a759-4075-a545-c4cc1e52719c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b370f6-639e-4da7-80f0-8c5d40f926c6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:11 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:11 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[409cbb79-b59d-4e30-ad76-06af1c1908d2]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyDCNgSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:30:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:30:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=24.71004867553711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:30:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Applying migration context for instance 581e2c46-293f-40a8-90bc-44188395eaba as it has an incoming, in-progress migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187. Migration status is finished {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 13:30:12 user nova-compute[74701]: INFO nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating resource usage from migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f5fa149e-2c53-42c6-8582-8dc13ea18857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b654cfe2-500f-4ffb-85c3-8bc19631984c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23031613039353738', 'path': '/dev/sdf'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031613039353738', 'path': '/dev/sdf'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:30:12 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:12 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:30:12 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:12 user nova-compute[74701]:   <serial>2486d134-43a4-4fff-9ab2-ba5d8c0e5eef</serial>
Oct 20 13:30:12 user nova-compute[74701]: </disk>
Oct 20 13:30:12 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No VIF found with MAC fa:16:3e:c1:78:65, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-657e4567-1d37-4fd0-acfa-204b2ff8a613 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.109s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:30:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:30:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.009s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:26 user nova-compute[74701]: INFO nova.compute.manager [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Terminating instance
Oct 20 13:30:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:26 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b654cfe2-500f-4ffb-85c3-8bc19631984c is timed out.
Oct 20 13:30:26 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Successfully detached device vdb from instance b654cfe2-500f-4ffb-85c3-8bc19631984c from the live domain config.
Oct 20 13:30:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQkxRETi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:26 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6643a-554f-4dcb-ba28-9bd56425b07e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:30:26 user nova-compute[74701]: No targets found.
Oct 20 13:30:26 user nova-compute[74701]: iSNS:
Oct 20 13:30:26 user nova-compute[74701]: No targets found.
Oct 20 13:30:26 user nova-compute[74701]: STATIC:
Oct 20 13:30:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:30:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef
Oct 20 13:30:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:30:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10
Oct 20 13:30:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:26 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:30:26 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:26 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:26 user nova-compute[74701]: FIRMWARE:
Oct 20 13:30:26 user nova-compute[74701]: No targets found.
Oct 20 13:30:26 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:30:26 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:30:26 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcfbcc2-016e-49d7-a9c0-905f8c671e4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1171358a-7f38-4b7c-9c97-b967211a5536]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e011c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10'): ({'sde'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Removing single pathed devices sde {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-a095cbbb-77b0-4907-9b56-5a6ae8b5e233 req-fb2399e2-4803-4a4a-acea-6ac65597aa47 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-unplugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7486d354-36a1-4e07-b580-248a2a52135a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb83500b-9946-433e-a570-8272d2b7c198]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Flushing IO for device /dev/sde {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5a494-dd5f-4ff5-9786-d20d7ca21932]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e5e097-1e47-4f78-9268-5b0013a13474]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] SCSI volumes sde have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da3d7e9-7b71-49da-b2fb-525637659003]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[db790702-b9f2-44d3-976a-a4682bfe6a74]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260]
Oct 20 13:30:27 user nova-compute[74701]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc636dd-99d5-4acf-8aee-62c5d06d9d10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562a731-9873-4a56-a4d2-b78563612e0e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] <== disconnect_volume: return (388ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:30:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Instance destroyed successfully.
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 4053c98d-7a1e-4019-84b5-0ae71af9ff95 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-104078597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-104078597',id=22,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-8p43it6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:18:22Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=4053c98d-7a1e-4019-84b5-0ae71af9ff95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "address": "fa:16:3e:16:c4:94", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef878f89-a7", "ovs_interfaceid": "ef878f89-a7a8-42aa-8e95-d0f07446c226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_vif [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef878f89-a7, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a188e37-bdc8-40e8-ad2f-570217560c94) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:27 user nova-compute[74701]: INFO os_vif [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c4:94,bridge_name='br-int',has_traffic_filtering=True,id=ef878f89-a7a8-42aa-8e95-d0f07446c226,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef878f89-a7')
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVPdbkAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9da0f-acfa-4762-a815-eee3ceb102e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:30:27 user nova-compute[74701]: No targets found.
Oct 20 13:30:27 user nova-compute[74701]: iSNS:
Oct 20 13:30:27 user nova-compute[74701]: No targets found.
Oct 20 13:30:27 user nova-compute[74701]: STATIC:
Oct 20 13:30:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:30:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef
Oct 20 13:30:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5
Oct 20 13:30:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:27 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:30:27 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:27 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:27 user nova-compute[74701]: FIRMWARE:
Oct 20 13:30:27 user nova-compute[74701]: No targets found.
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:30:27 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:30:27 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1138faa1-ef2e-446c-8d4f-d3a78e080ef0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ca1b39-8d1e-43bd-b107-2713fce868df]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:27 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e011c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c4f7c-b5e4-4ac0-9935-4b38ee8c564c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418f33e-58e8-4a22-b46c-0c2b240a4c98]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac31da-189a-49e5-bf74-aec8248f4882]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d757b-8208-42ad-b464-a93a9f741c08]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a535901-889b-419a-a0ff-607d5c68358e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[829c5a72-8d99-45d5-93b5-85f5a2887aca]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260]
Oct 20 13:30:27 user nova-compute[74701]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5321679c-49d9-4caf-99ec-5af541fd2ac5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a50d20-f92c-4a25-9e99-171782d5fef3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] <== disconnect_volume: return (345ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:30:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Deleting instance files /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95_del
Oct 20 13:30:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Deletion of /opt/stack/data/nova/instances/4053c98d-7a1e-4019-84b5-0ae71af9ff95_del complete
Oct 20 13:30:27 user nova-compute[74701]: INFO nova.compute.manager [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 20 13:30:27 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:30:27 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:28 user nova-compute[74701]: INFO nova.compute.manager [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Terminating instance
Oct 20 13:30:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Took 1.08 seconds to deallocate network for instance.
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-ca4119f9-a30d-4cd1-b35d-a2951b8a4f7d req-e1d302a8-b631-4fa2-890c-d9133bbf76a4 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-deleted-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.compute.manager [req-ca4119f9-a30d-4cd1-b35d-a2951b8a4f7d req-e1d302a8-b631-4fa2-890c-d9133bbf76a4 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Neutron deleted interface ef878f89-a7a8-42aa-8e95-d0f07446c226; detaching it from the instance and deleting it from the info cache
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-ca4119f9-a30d-4cd1-b35d-a2951b8a4f7d req-e1d302a8-b631-4fa2-890c-d9133bbf76a4 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-ca4119f9-a30d-4cd1-b35d-a2951b8a4f7d req-e1d302a8-b631-4fa2-890c-d9133bbf76a4 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Detach interface failed, port_id=ef878f89-a7a8-42aa-8e95-d0f07446c226, reason: Instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Acquiring lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] No waiting events found dispatching network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:30:29 user nova-compute[74701]: WARNING nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Received unexpected event network-vif-plugged-ef878f89-a7a8-42aa-8e95-d0f07446c226 for instance with vm_state active and task_state deleting.
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing instance network info cache due to event network-changed-4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Acquiring lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Acquired lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Refreshing network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lazy-loading 'flavor' on Instance uuid b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c6400336-55d3-425f-b41b-c0235dd11a30 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.968s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Instance destroyed successfully.
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lazy-loading 'resources' on Instance uuid f5fa149e-2c53-42c6-8582-8dc13ea18857 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1217431802',display_name='tempest-TestStampPattern-server-1217431802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1217431802',id=33,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRY3FcnFKb+nEnmHKHWEbtnRZvwl3otOe8cNZs7GqiaHV1z1Y4wkfDzjx7JrZHtUQphATwBg+Y8xbIr2Pw8/BXsCGEOelAXJSeJx8T45EchmfUExMvb/PWD7dAJmWTT5g==',key_name='tempest-TestStampPattern-115083403',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04d12fee426e4728a322fc03e1f2d506',ramdisk_id='',reservation_id='r-4mznt842',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1055047061',owner_user_name='tempest-TestStampPattern-1055047061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:26:05Z,user_data=None,user_id='819014923a4d471fa9a109ba59da3ed5',uuid=f5fa149e-2c53-42c6-8582-8dc13ea18857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converting VIF {"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG os_vif [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4860330a-fe, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3cfdad4-4edb-47b1-bf28-53098168bad9) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:30:29 user nova-compute[74701]: INFO os_vif [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f9:0c,bridge_name='br-int',has_traffic_filtering=True,id=4860330a-feb1-4b0e-8b1e-6f45fbc66780,network=Network(48c86249-67d7-4877-8b89-7d646e0d10fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4860330a-fe')
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Deleting instance files /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857_del
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Deletion of /opt/stack/data/nova/instances/f5fa149e-2c53-42c6-8582-8dc13ea18857_del complete
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updated VIF entry in instance network info cache for port 4860330a-feb1-4b0e-8b1e-6f45fbc66780. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [{"id": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "address": "fa:16:3e:fa:f9:0c", "network": {"id": "48c86249-67d7-4877-8b89-7d646e0d10fd", "bridge": "br-int", "label": "tempest-TestStampPattern-938674830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d12fee426e4728a322fc03e1f2d506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4860330a-fe", "ovs_interfaceid": "4860330a-feb1-4b0e-8b1e-6f45fbc66780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Releasing lock "refresh_cache-f5fa149e-2c53-42c6-8582-8dc13ea18857" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-unplugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] No waiting events found dispatching network-vif-unplugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [req-db626860-db16-4808-a1f5-c89152af5713 req-76aa663d-22ff-4135-a6af-9d2cd4f26376 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-unplugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:30:29 user nova-compute[74701]: INFO nova.compute.manager [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 13:30:29 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:30:29 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:30 user nova-compute[74701]: INFO nova.compute.manager [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 4053c98d-7a1e-4019-84b5-0ae71af9ff95] Took 1.04 seconds to detach 1 volumes for instance.
Oct 20 13:30:30 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Took 0.46 seconds to deallocate network for instance.
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.339s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:30 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Deleted allocations for instance 4053c98d-7a1e-4019-84b5-0ae71af9ff95
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ce30442a-bdaf-4d78-b6c8-0c05f555b051 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "4053c98d-7a1e-4019-84b5-0ae71af9ff95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.907s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:30:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:30 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Deleted allocations for instance f5fa149e-2c53-42c6-8582-8dc13ea18857
Oct 20 13:30:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9f573ce0-ea7d-4db4-84b7-029c6f446e9f tempest-TestStampPattern-1055047061 tempest-TestStampPattern-1055047061-project-member] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-d5dafcc4-e476-4b12-88c7-e1e124f21b6a req-54a7a2ed-a047-4814-aaab-e8c8c103dfc6 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-deleted-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] Acquiring lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] Lock "f5fa149e-2c53-42c6-8582-8dc13ea18857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] No waiting events found dispatching network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:30:31 user nova-compute[74701]: WARNING nova.compute.manager [req-77ef9a82-6602-4dfa-bab3-f91b599467cc req-61d1424d-ccff-4d77-87bd-2f4dd1a846d9 service nova] [instance: f5fa149e-2c53-42c6-8582-8dc13ea18857] Received unexpected event network-vif-plugged-4860330a-feb1-4b0e-8b1e-6f45fbc66780 for instance with vm_state deleted and task_state None.
Oct 20 13:30:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-changed-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Refreshing instance network info cache due to event network-changed-1d965f32-bbff-4bb7-b372-91189ee8d027. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] Acquiring lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] Acquired lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Refreshing network info cache for port 1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:35 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Ignoring supplied device name: /dev/vdb
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:35 user nova-compute[74701]: INFO nova.compute.manager [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Attaching volume 7f79b4c6-89a8-4f84-966e-fcfde65e14e3 to /dev/vdb
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.utils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19ca75-42da-4a19-ac89-b07872d81cbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da0768-6c56-4247-9ecc-2b245cb53417]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c82e7-520f-45c1-a54c-13968c149d13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d6634-bdf7-4972-9822-2ccf55d895e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG nova.network.neutron [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updated VIF entry in instance network info cache for port 1d965f32-bbff-4bb7-b372-91189ee8d027. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG nova.network.neutron [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating instance_info_cache with network_info: [{"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-384bfd53-a14a-4586-8db8-121071255835 req-7ae12ca9-6a2b-4d67-9144-ac5e9b65d157 service nova] Releasing lock "refresh_cache-d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:30:36 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:30:36 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c8b19b-3230-4b48-be52-5ee3c00859cd]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG os_brick.utils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:36 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating existing volume attachment record: c6060b2a-32b5-4fc9-bd19-d17ad0c5f95f {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:30:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:38 user nova-compute[74701]: INFO nova.compute.manager [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Detaching volume d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:30:38 user nova-compute[74701]: INFO nova.virt.block_device [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Attempting to driver detach volume d42c4367-71c5-489b-a55a-8db2367be42c from mountpoint /dev/vdb
Oct 20 13:30:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Attempting to detach device vdb from instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:30:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:38 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:38 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:30:38 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:38 user nova-compute[74701]:   <serial>d42c4367-71c5-489b-a55a-8db2367be42c</serial>
Oct 20 13:30:38 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:30:38 user nova-compute[74701]: </disk>
Oct 20 13:30:38 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:38 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdb from instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 from the persistent domain config.
Oct 20 13:30:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:30:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:38 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:38 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:30:38 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:38 user nova-compute[74701]:   <serial>d42c4367-71c5-489b-a55a-8db2367be42c</serial>
Oct 20 13:30:38 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:30:38 user nova-compute[74701]: </disk>
Oct 20 13:30:38 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:30:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:45 user nova-compute[74701]: INFO nova.compute.manager [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Detaching volume 2486d134-43a4-4fff-9ab2-ba5d8c0e5eef
Oct 20 13:30:45 user nova-compute[74701]: INFO nova.virt.block_device [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attempting to driver detach volume 2486d134-43a4-4fff-9ab2-ba5d8c0e5eef from mountpoint /dev/vdb
Oct 20 13:30:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Attempting to detach device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:30:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:46 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:46 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:30:46 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:46 user nova-compute[74701]:   <serial>2486d134-43a4-4fff-9ab2-ba5d8c0e5eef</serial>
Oct 20 13:30:46 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:30:46 user nova-compute[74701]: </disk>
Oct 20 13:30:46 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config.
Oct 20 13:30:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:30:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:30:46 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:46 user nova-compute[74701]:   <source dev="/dev/sdf"/>
Oct 20 13:30:46 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:46 user nova-compute[74701]:   <serial>2486d134-43a4-4fff-9ab2-ba5d8c0e5eef</serial>
Oct 20 13:30:46 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:30:46 user nova-compute[74701]: </disk>
Oct 20 13:30:46 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:30:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:30:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjOTkXod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:53 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:53 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f87fa0-9a98-4313-ba0d-c4dc07b8d576]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:30:53 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc36190-24fe-406f-80ef-d38e90bb8a1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3] added
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88dd09-14c8-457a-a8c2-e96cfaeadf83]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b897ddc-ec5d-470b-bcf3-66f773189a6e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjOTkXod {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjOTkXod" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fbc9b-e0fe-4642-a06e-75c453ad4ffe]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjOTkXod'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e1695-1edc-4802-8245-89d01b4149b4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[215db7b9-d9ce-422b-a05f-a80f6fd37cd8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585bd8e-13ed-4b24-9167-26e2a2815ff1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260]
Oct 20 13:30:53 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e75347-a95f-4058-bbb5-08e9ec56c539]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[697eac52-b57a-4d47-b8cf-cd2845f8a49e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:53 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:30:53 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78043a0b-bef7-4fb1-8709-f6e4ca38549f]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:53 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjOTkXod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26166386264333163', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166386264333163', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG nova.objects.instance [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:30:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:30:54 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:30:54 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:30:54 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:30:54 user nova-compute[74701]:   <serial>7f79b4c6-89a8-4f84-966e-fcfde65e14e3</serial>
Oct 20 13:30:54 user nova-compute[74701]: </disk>
Oct 20 13:30:54 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:30:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:30:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] No VIF found with MAC fa:16:3e:f4:ab:18, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:30:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-92965f5b-4c56-475f-8a0b-69b8130db977 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.420s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:30:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 is timed out.
Oct 20 13:30:59 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdb from instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 from the live domain config.
Oct 20 13:30:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkVCquhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:30:59 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69829a-3882-4641-a620-3722c7655742]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:30:59 user nova-compute[74701]: No targets found.
Oct 20 13:30:59 user nova-compute[74701]: iSNS:
Oct 20 13:30:59 user nova-compute[74701]: No targets found.
Oct 20 13:30:59 user nova-compute[74701]: STATIC:
Oct 20 13:30:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:30:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef
Oct 20 13:30:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3
Oct 20 13:30:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:59 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c
Oct 20 13:30:59 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:30:59 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:30:59 user nova-compute[74701]: FIRMWARE:
Oct 20 13:30:59 user nova-compute[74701]: No targets found.
Oct 20 13:30:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:30:59 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:30:59 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea166a81-4ba9-45df-8cb1-0d4a76258969]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cb6869-6dea-4131-aa1e-0a11d715b514]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:30:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:30:59 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:30:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc621240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b3c08-ff7a-4466-b562-39f85be4f95e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c6839-895a-48ec-8add-5c8972282ed2]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c992f51-4e9f-470a-9d48-5fe1609fec55]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb00199-185c-4b40-8b6e-c1a297ed5696]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b8918-82fb-486e-91c1-19f47eafb4e5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6424489e-cd2e-4ed7-aba4-83860445546f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260]
Oct 20 13:30:59 user nova-compute[74701]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c, portal: 172.16.0.220,3260] successful.
Oct 20 13:30:59 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42c4367-71c5-489b-a55a-8db2367be42c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27383bb3-e296-42d1-b2ff-4cbe2dc94909]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== disconnect_volume: return (332ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:30:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Going to confirm migration 2 {{(pid=74701) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquired lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'info_cache' on Instance uuid 581e2c46-293f-40a8-90bc-44188395eaba {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1c29f9fe-eab8-4615-85c1-580bd5c55063 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.782s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [{"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Releasing lock "refresh_cache-581e2c46-293f-40a8-90bc-44188395eaba" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'migration_context' on Instance uuid 581e2c46-293f-40a8-90bc-44188395eaba {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.objects.base [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Object Instance<581e2c46-293f-40a8-90bc-44188395eaba> lazy-loaded attributes: info_cache,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:31:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.379s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:01 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Deleted allocation for migration 75e119f8-f59c-4a76-8be6-8b8fe5e69187
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74701) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-064470ed-d265-40ce-bff6-e82c67f7227f tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.323s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:01 user nova-compute[74701]: WARNING nova.compute.manager [req-ed50eef0-8763-41cf-ad6c-dcf78434d198 req-d0cdd728-6604-4ad9-a886-adb22a8c56c8 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state active and task_state powering-off.
Oct 20 13:31:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance destroyed successfully.
Oct 20 13:31:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:31:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eacc1c9e-ed74-4a92-96ff-e958ba1548df tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:03 user nova-compute[74701]: WARNING nova.compute.manager [req-179bba99-b336-4423-a34a-4a887958304d req-c2eddc90-ad7a-43b5-9e99-b028efe044a0 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state stopped and task_state None.
Oct 20 13:31:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:06 user nova-compute[74701]: INFO nova.compute.manager [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Terminating instance
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:06 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 is timed out.
Oct 20 13:31:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config.
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iyDCNgSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:31:06 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[789aceda-f9a3-476c-b4b0-e5504142bfc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:31:06 user nova-compute[74701]: No targets found.
Oct 20 13:31:06 user nova-compute[74701]: iSNS:
Oct 20 13:31:06 user nova-compute[74701]: No targets found.
Oct 20 13:31:06 user nova-compute[74701]: STATIC:
Oct 20 13:31:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:31:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:31:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:31:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef
Oct 20 13:31:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:31:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:31:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3
Oct 20 13:31:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:31:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:31:06 user nova-compute[74701]: FIRMWARE:
Oct 20 13:31:06 user nova-compute[74701]: No targets found.
Oct 20 13:31:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:31:06 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:31:06 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46dbce-51ed-4e20-b91d-f47ac01c7953]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[716b9f13-83f3-4ab6-b0e8-fd44d7819c88]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:31:06 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:31:06 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:31:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:31:06 user nova-compute[74701]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef (non-flash)
Oct 20 13:31:06 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:31:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86f81d04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef'): ({'sdf'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Removing single pathed devices sdf {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b9236-c684-4b0e-b7a1-63407050af5f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6a285-914a-4003-a02d-444659f9ae52]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flushing IO for device /dev/sdf {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe1872f-c9f9-4156-9cb3-53953faf1139]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-unplugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] No waiting events found dispatching network-vif-unplugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-44f3e03c-90fe-4e9f-8fa4-a65b8bd468f9 req-12f8a3aa-0d0c-4e93-bd9e-5dffaec9d6bc service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-unplugged-ee475172-4f64-4d3d-984a-7ce01df9c49d for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3639f-459a-449e-bfa7-e8f7a14256ad]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] SCSI volumes sdf have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70deec3-1cd0-409b-8a5c-1a269e58faf4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6504f1-da67-43df-bfed-bfcec77640ad]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260]
Oct 20 13:31:06 user nova-compute[74701]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef, portal: 172.16.0.220,3260] successful.
Oct 20 13:31:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2486d134-43a4-4fff-9ab2-ba5d8c0e5eef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c7bf6-31d3-474e-9d1d-895deb6f83a2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== disconnect_volume: return (364ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:31:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:31:07 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Instance destroyed successfully.
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lazy-loading 'resources' on Instance uuid b654cfe2-500f-4ffb-85c3-8bc19631984c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1438595647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1438595',id=40,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr71q4F3Gh3CEI/bgcegD1nEY3o7+wYY2ibjdnnQu0XY9twg9a9PQd/+V9Zwztvzt4Ke5wi3QIghw6E1PtLJYhUfDHBDVUixUoNQp7DzxUjOD7mj1FcS4u8qups8G1w0A==',key_name='tempest-keypair-903568916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:27:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce0888325924d82aa5e9bce837eab3d',ramdisk_id='',reservation_id='r-1006rmfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162b18571b984806959d5fa3177bbf6e',uuid=b654cfe2-500f-4ffb-85c3-8bc19631984c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converting VIF {"id": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "address": "fa:16:3e:50:f8:51", "network": {"id": "b08f8a78-bf14-47b1-840d-48c358e7b33a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1068042232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce0888325924d82aa5e9bce837eab3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee475172-4f", "ovs_interfaceid": "ee475172-4f64-4d3d-984a-7ce01df9c49d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG os_vif [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee475172-4f, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1084f63b-8b1f-46d9-8375-ad457e460347) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:07 user nova-compute[74701]: INFO os_vif [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:f8:51,bridge_name='br-int',has_traffic_filtering=True,id=ee475172-4f64-4d3d-984a-7ce01df9c49d,network=Network(b08f8a78-bf14-47b1-840d-48c358e7b33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee475172-4f')
Oct 20 13:31:07 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Deleting instance files /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c_del
Oct 20 13:31:07 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Deletion of /opt/stack/data/nova/instances/b654cfe2-500f-4ffb-85c3-8bc19631984c_del complete
Oct 20 13:31:07 user nova-compute[74701]: INFO nova.compute.manager [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 20 13:31:07 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3fd27655-887d-49a3-a55c-2bfe87eec3f6 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:08 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Took 1.01 seconds to deallocate network for instance.
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-bef3deba-ed00-4cd6-8f4e-707f00a269ae req-c6bd758a-1704-4905-a3ee-b6700ef6b339 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-deleted-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:08 user nova-compute[74701]: INFO nova.compute.manager [req-bef3deba-ed00-4cd6-8f4e-707f00a269ae req-c6bd758a-1704-4905-a3ee-b6700ef6b339 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Neutron deleted interface ee475172-4f64-4d3d-984a-7ce01df9c49d; detaching it from the instance and deleting it from the info cache
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-bef3deba-ed00-4cd6-8f4e-707f00a269ae req-c6bd758a-1704-4905-a3ee-b6700ef6b339 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-bef3deba-ed00-4cd6-8f4e-707f00a269ae req-c6bd758a-1704-4905-a3ee-b6700ef6b339 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Detach interface failed, port_id=ee475172-4f64-4d3d-984a-7ce01df9c49d, reason: Instance b654cfe2-500f-4ffb-85c3-8bc19631984c could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:08 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Deleted allocations for instance b654cfe2-500f-4ffb-85c3-8bc19631984c
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] Acquiring lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] No waiting events found dispatching network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:08 user nova-compute[74701]: WARNING nova.compute.manager [req-aaf5adff-7df7-4e5c-b0bd-9e596c2a0849 req-67b1a818-bf91-452c-9405-b2fdd3222d88 service nova] [instance: b654cfe2-500f-4ffb-85c3-8bc19631984c] Received unexpected event network-vif-plugged-ee475172-4f64-4d3d-984a-7ce01df9c49d for instance with vm_state deleted and task_state None.
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8a8b25fb-7552-4c26-a97d-35b4d0bbdd14 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732 tempest-TestServerVolumeAttachScenarioOldVersion-1178317732-project-member] Lock "b654cfe2-500f-4ffb-85c3-8bc19631984c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.509s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:31:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8190MB free_disk=24.851654052734375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:31:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:13 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:31:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [{"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-1458c67f-2bbe-45d9-9c33-130b83f58dfd" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:17 user nova-compute[74701]: INFO nova.compute.manager [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Terminating instance
Oct 20 13:31:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-unplugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] No waiting events found dispatching network-vif-unplugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-c7771e66-03c2-4eb9-a59e-81afdbe1a61a req-b5a49e6f-6d94-4a7b-a850-6ba91bd87fea service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-unplugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Instance destroyed successfully.
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lazy-loading 'resources' on Instance uuid 1458c67f-2bbe-45d9-9c33-130b83f58dfd {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-287900680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-287900680',id=14,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ed52bceb45147ceb782e49acf3a9d39',ramdisk_id='',reservation_id='r-kkfip6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:13:32Z,user_data=None,user_id='751a8755f9774b1da2e71623164c40b9',uuid=1458c67f-2bbe-45d9-9c33-130b83f58dfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converting VIF {"id": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "address": "fa:16:3e:c6:29:2a", "network": {"id": "289e9201-aba3-4f8d-aef4-40b765ca8481", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1404542668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ed52bceb45147ceb782e49acf3a9d39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9072d2f8-70", "ovs_interfaceid": "9072d2f8-7091-470b-b00a-23eba08d6eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG os_vif [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9072d2f8-70, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e054e8d-9589-4b61-84b8-21f831c7a8d3) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:18 user nova-compute[74701]: INFO os_vif [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:29:2a,bridge_name='br-int',has_traffic_filtering=True,id=9072d2f8-7091-470b-b00a-23eba08d6eb9,network=Network(289e9201-aba3-4f8d-aef4-40b765ca8481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9072d2f8-70')
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Deleting instance files /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd_del
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Deletion of /opt/stack/data/nova/instances/1458c67f-2bbe-45d9-9c33-130b83f58dfd_del complete
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.compute.manager [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Took 0.49 seconds to deallocate network for instance.
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-23be2ba5-bd20-444f-99df-17fbcbc83a95 req-3dd718c3-fc80-4669-99ce-97ae95a0461b service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-deleted-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:18 user nova-compute[74701]: INFO nova.compute.manager [req-23be2ba5-bd20-444f-99df-17fbcbc83a95 req-3dd718c3-fc80-4669-99ce-97ae95a0461b service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Neutron deleted interface 9072d2f8-7091-470b-b00a-23eba08d6eb9; detaching it from the instance and deleting it from the info cache
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.network.neutron [req-23be2ba5-bd20-444f-99df-17fbcbc83a95 req-3dd718c3-fc80-4669-99ce-97ae95a0461b service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-23be2ba5-bd20-444f-99df-17fbcbc83a95 req-3dd718c3-fc80-4669-99ce-97ae95a0461b service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Detach interface failed, port_id=9072d2f8-7091-470b-b00a-23eba08d6eb9, reason: Instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:31:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:31:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:19 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Deleted allocations for instance 1458c67f-2bbe-45d9-9c33-130b83f58dfd
Oct 20 13:31:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d26673eb-04b1-48d6-8db0-49ac69d0cae2 tempest-ServerBootFromVolumeStableRescueTest-1693514684 tempest-ServerBootFromVolumeStableRescueTest-1693514684-project-member] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.653s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:31:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:31:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] Acquiring lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] Lock "1458c67f-2bbe-45d9-9c33-130b83f58dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] No waiting events found dispatching network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:31:20 user nova-compute[74701]: WARNING nova.compute.manager [req-7c62fe46-961b-4bb1-81f6-cb4212f6088a req-24a526b7-81cf-4ad7-992b-8a03edd62c71 service nova] [instance: 1458c67f-2bbe-45d9-9c33-130b83f58dfd] Received unexpected event network-vif-plugged-9072d2f8-7091-470b-b00a-23eba08d6eb9 for instance with vm_state deleted and task_state None.
Oct 20 13:31:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:31:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:31:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:56 user nova-compute[74701]: INFO nova.compute.manager [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Detaching volume 7f79b4c6-89a8-4f84-966e-fcfde65e14e3
Oct 20 13:31:56 user nova-compute[74701]: INFO nova.virt.block_device [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Attempting to driver detach volume 7f79b4c6-89a8-4f84-966e-fcfde65e14e3 from mountpoint /dev/vdb
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Attempting to detach device vdb from instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:31:56 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:31:56 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:31:56 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:31:56 user nova-compute[74701]:   <serial>7f79b4c6-89a8-4f84-966e-fcfde65e14e3</serial>
Oct 20 13:31:56 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:31:56 user nova-compute[74701]: </disk>
Oct 20 13:31:56 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:31:56 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully detached device vdb from instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc from the persistent domain config.
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:31:56 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:31:56 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:31:56 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:31:56 user nova-compute[74701]:   <serial>7f79b4c6-89a8-4f84-966e-fcfde65e14e3</serial>
Oct 20 13:31:56 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:31:56 user nova-compute[74701]: </disk>
Oct 20 13:31:56 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.objects.instance [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:31:56 user nova-compute[74701]: INFO nova.compute.manager [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attaching volume 455e6127-18b1-443e-848f-2cac3cdf3561 to /dev/vdb
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.utils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101b3df-dd13-4005-9c8d-5b8bdda1b2cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b72312-ad29-4f64-b54b-039b04528ab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a066f-dc07-4823-be3b-dc1f40142945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab16b0-d12c-46a0-9f27-f437ea3adc25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:31:56 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:31:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc187a0-86c7-482d-a473-674282e2a2fd]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG os_brick.utils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:31:56 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating existing volume attachment record: 058ff3f6-04e4-4c4d-8692-fb386ae29938 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:31:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:31:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:07 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:32:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:32:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:32:09 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:32:11 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=24.965839385986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:32:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnkVqdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:32:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:32:13 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:32:13 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee8a159-582d-4757-8c4b-43e8803f1229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:32:13 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644ace3-b727-446e-bbbd-234fcddf25bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561] added
Oct 20 13:32:13 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce89fc-3bea-4ce7-b094-b0815120211f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7b42dd-d758-4bbb-b9cc-201ca397ccd3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnkVqdLw {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnkVqdLw" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacf570-c902-4632-b5b8-9275565f0b1b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bnkVqdLw'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06919a-27e8-41e6-8e21-5631e0264e30]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[635263c5-cbf9-4426-9410-49fe2272c111]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbdd5e-8cc9-4b8d-af24-fc85581f21aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260]
Oct 20 13:32:14 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260] successful.
Oct 20 13:32:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[04804c1f-3e1a-4adb-84c7-16080e7742b4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a1a85-5e8d-42be-b6f4-e8c32f9be3c8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e58c29f-eec0-4c5a-9be6-aaabc9d7a5ca]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnkVqdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [{"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26139376362313131', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139376362313131', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.objects.instance [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:32:15 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:32:15 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:32:15 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:32:15 user nova-compute[74701]:   <serial>455e6127-18b1-443e-848f-2cac3cdf3561</serial>
Oct 20 13:32:15 user nova-compute[74701]: </disk>
Oct 20 13:32:15 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No VIF found with MAC fa:16:3e:c1:78:65, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:32:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-59f7cd7b-9009-4824-a527-3f7330551e79 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.355s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:16 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc is timed out.
Oct 20 13:32:16 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully detached device vdb from instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc from the live domain config.
Oct 20 13:32:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjOTkXod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:32:16 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd015a-c20f-48e5-8545-424435842a85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:32:16 user nova-compute[74701]: No targets found.
Oct 20 13:32:16 user nova-compute[74701]: iSNS:
Oct 20 13:32:16 user nova-compute[74701]: No targets found.
Oct 20 13:32:16 user nova-compute[74701]: STATIC:
Oct 20 13:32:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:32:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561
Oct 20 13:32:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:16 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3
Oct 20 13:32:16 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:16 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:16 user nova-compute[74701]: FIRMWARE:
Oct 20 13:32:16 user nova-compute[74701]: No targets found.
Oct 20 13:32:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:32:16 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:32:16 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74a9fd-90c6-462e-83c0-2166c49bfb69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb8465-e828-47ca-893e-d8619e3bc5d4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:16 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:16 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:16 user nova-compute[74701]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 (non-flash)
Oct 20 13:32:16 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc7ab9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76d35f-1c06-4f83-b2ec-c08dcfad054f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68be8b7-c883-4e87-ae29-85bf91fefa90]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db621c-ee6f-4d6d-86c8-28f57402ddf6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b22b8-cde3-4b69-b90b-a2c9818bb789]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c298a-a89c-46ff-a186-e4aca2c8ee72]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1b83a-dfce-486f-81d0-935632c34928]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260]
Oct 20 13:32:16 user nova-compute[74701]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3, portal: 172.16.0.220,3260] successful.
Oct 20 13:32:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc20935e-9a95-4f9e-83a6-b7fa811ea5dd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== disconnect_volume: return (303ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:32:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG nova.objects.instance [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'flavor' on Instance uuid d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-155fc32b-6bed-453c-b26e-e6d8e314b4e5 tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.708s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:17 user nova-compute[74701]: INFO nova.compute.manager [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Terminating instance
Oct 20 13:32:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-unplugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] No waiting events found dispatching network-vif-unplugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-95933b7c-2d36-4d41-b592-5584b40ad74f req-37f97947-c6d3-4f64-a988-226e6fdd0b44 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-unplugged-1d965f32-bbff-4bb7-b372-91189ee8d027 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Instance destroyed successfully.
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lazy-loading 'resources' on Instance uuid d05dfc01-7ac1-4711-9092-a4d6e6a7eadc {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1271648214',display_name='tempest-VolumesSnapshotTestJSON-instance-1271648214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1271648214',id=42,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+/cnKeyhPCgxB8eidxdlqbwGhfmj5RYK4ETfVLxoUVOV3AB/NpsKw9SnqVIQDI04ehkPFirBF5ZNkXDrTlORZlrbQ6RbQz9fCsxUo+no+xolkrenOC4lf/RgOHEjv/IA==',key_name='tempest-keypair-663477142',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f81e60db14814ef8b68dda080fba920e',ramdisk_id='',reservation_id='r-7vzh7ix2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2076407407',owner_user_name='tempest-VolumesSnapshotTestJSON-2076407407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b23e0648e74a0ebdf77a03d4fe9483',uuid=d05dfc01-7ac1-4711-9092-a4d6e6a7eadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converting VIF {"id": "1d965f32-bbff-4bb7-b372-91189ee8d027", "address": "fa:16:3e:f4:ab:18", "network": {"id": "4aa469cf-239f-4169-9d8d-dc424d1d366f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1603269099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81e60db14814ef8b68dda080fba920e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d965f32-bb", "ovs_interfaceid": "1d965f32-bbff-4bb7-b372-91189ee8d027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_vif [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d965f32-bb, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.compute.manager [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Detaching volume 455e6127-18b1-443e-848f-2cac3cdf3561
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b7b104-83e6-434c-8fee-264539cfa9d3) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:18 user nova-compute[74701]: INFO os_vif [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ab:18,bridge_name='br-int',has_traffic_filtering=True,id=1d965f32-bbff-4bb7-b372-91189ee8d027,network=Network(4aa469cf-239f-4169-9d8d-dc424d1d366f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d965f32-bb')
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjOTkXod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:32:18 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c68aa-dee0-42ea-856f-c03f2cc9b349]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:32:18 user nova-compute[74701]: No targets found.
Oct 20 13:32:18 user nova-compute[74701]: iSNS:
Oct 20 13:32:18 user nova-compute[74701]: No targets found.
Oct 20 13:32:18 user nova-compute[74701]: STATIC:
Oct 20 13:32:18 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:32:18 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:18 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:18 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561
Oct 20 13:32:18 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:18 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:18 user nova-compute[74701]: FIRMWARE:
Oct 20 13:32:18 user nova-compute[74701]: No targets found.
Oct 20 13:32:18 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:32:18 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:32:18 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f79b4c6-89a8-4f84-966e-fcfde65e14e3', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.virt.block_device [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attempting to driver detach volume 455e6127-18b1-443e-848f-2cac3cdf3561 from mountpoint /dev/vdb
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3b632-7ff1-46cb-a3ed-34522997d903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Attempting to detach device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:32:18 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:32:18 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:32:18 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:32:18 user nova-compute[74701]:   <serial>455e6127-18b1-443e-848f-2cac3cdf3561</serial>
Oct 20 13:32:18 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:32:18 user nova-compute[74701]: </disk>
Oct 20 13:32:18 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config.
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:32:18 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:32:18 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:32:18 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:32:18 user nova-compute[74701]:   <serial>455e6127-18b1-443e-848f-2cac3cdf3561</serial>
Oct 20 13:32:18 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:32:18 user nova-compute[74701]: </disk>
Oct 20 13:32:18 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afcfe9-6b93-4249-8faf-15d7593b2ac1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:18 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:18 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:18 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:18 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e063aef0>, {}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Disconnecting from: [] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] <== disconnect_volume: return (92ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Deleting instance files /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc_del
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Deletion of /opt/stack/data/nova/instances/d05dfc01-7ac1-4711-9092-a4d6e6a7eadc_del complete
Oct 20 13:32:18 user nova-compute[74701]: INFO nova.compute.manager [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 13:32:18 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:32:18 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:19 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Took 0.75 seconds to deallocate network for instance.
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-3194f0a3-78d3-4565-aef6-addc3d933f37 req-488145e1-94f6-418a-aacb-ce3c48bfa8a5 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-deleted-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:19 user nova-compute[74701]: INFO nova.compute.manager [req-3194f0a3-78d3-4565-aef6-addc3d933f37 req-488145e1-94f6-418a-aacb-ce3c48bfa8a5 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Neutron deleted interface 1d965f32-bbff-4bb7-b372-91189ee8d027; detaching it from the instance and deleting it from the info cache
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.network.neutron [req-3194f0a3-78d3-4565-aef6-addc3d933f37 req-488145e1-94f6-418a-aacb-ce3c48bfa8a5 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:19 user nova-compute[74701]: WARNING nova.volume.cinder [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Attachment c6060b2a-32b5-4fc9-bd19-d17ad0c5f95f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c6060b2a-32b5-4fc9-bd19-d17ad0c5f95f. (HTTP 404) (Request-ID: req-188cdf4b-836a-438a-812b-d326be084387)
Oct 20 13:32:19 user nova-compute[74701]: INFO nova.compute.manager [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.compute.manager [req-3194f0a3-78d3-4565-aef6-addc3d933f37 req-488145e1-94f6-418a-aacb-ce3c48bfa8a5 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Detach interface failed, port_id=1d965f32-bbff-4bb7-b372-91189ee8d027, reason: Instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:32:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:20 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Deleted allocations for instance d05dfc01-7ac1-4711-9092-a4d6e6a7eadc
Oct 20 13:32:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1479f7c8-7a4f-456f-a6cd-1f527335b18d tempest-VolumesSnapshotTestJSON-2076407407 tempest-VolumesSnapshotTestJSON-2076407407-project-member] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] Acquiring lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] Lock "d05dfc01-7ac1-4711-9092-a4d6e6a7eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] No waiting events found dispatching network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:32:20 user nova-compute[74701]: WARNING nova.compute.manager [req-ab5948f6-f97b-4778-9826-740898330d36 req-5ae5d12c-4da0-4196-b104-f3dd96d2c427 service nova] [instance: d05dfc01-7ac1-4711-9092-a4d6e6a7eadc] Received unexpected event network-vif-plugged-1d965f32-bbff-4bb7-b372-91189ee8d027 for instance with vm_state deleted and task_state None.
Oct 20 13:32:20 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:32:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:32:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:39 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 is timed out.
Oct 20 13:32:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config.
Oct 20 13:32:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnkVqdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:32:39 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fe6f5-b4bc-43f5-bb22-fd41217d90f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:32:39 user nova-compute[74701]: No targets found.
Oct 20 13:32:39 user nova-compute[74701]: iSNS:
Oct 20 13:32:39 user nova-compute[74701]: No targets found.
Oct 20 13:32:39 user nova-compute[74701]: STATIC:
Oct 20 13:32:39 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:32:39 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:39 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:39 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561
Oct 20 13:32:39 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:32:39 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:32:39 user nova-compute[74701]: FIRMWARE:
Oct 20 13:32:39 user nova-compute[74701]: No targets found.
Oct 20 13:32:39 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:32:39 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:32:39 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2589d37e-44a1-4693-8258-7709f364136a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e411a-5fc4-49ad-986e-1ba18e1e3482]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:39 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:39 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:32:39 user nova-compute[74701]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 (non-flash)
Oct 20 13:32:39 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc622830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9eb597-6e33-408f-b4b0-63aefe6fa676]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[55896489-7eb8-4d50-a87a-ac76b6a164f7]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086701e-1c6d-4083-bf63-62568dc3eedd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2960e52-a110-4978-b3ff-0283248cb1ee]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[55517f39-989b-44a5-b25b-0b165130c789]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d9aa7-8a7d-4a72-a940-04ff3c0053cd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260]
Oct 20 13:32:39 user nova-compute[74701]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561, portal: 172.16.0.220,3260] successful.
Oct 20 13:32:39 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:455e6127-18b1-443e-848f-2cac3cdf3561 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f7871-bdfe-4570-9b0a-13792c0503a8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== disconnect_volume: return (304ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:32:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:32:40 user nova-compute[74701]: DEBUG nova.objects.instance [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-537551e2-7dfa-4969-8348-dbf9015ad532 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:32:43 user nova-compute[74701]: INFO nova.compute.claims [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Claim successful on node user
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:32:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:32:43 user nova-compute[74701]: INFO nova.virt.block_device [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Booting with volume snapshot 18d3057d-552f-4758-b925-7650ea762cd4 at /dev/vda
Oct 20 13:32:43 user nova-compute[74701]: DEBUG nova.policy [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:32:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:44 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Successfully created port: cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Successfully updated port: cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-changed-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Refreshing instance network info cache due to event network-changed-cb65da92-dce7-42ba-9cd5-74e1dd77e147. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] Acquiring lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.network.neutron [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updating instance_info_cache with network_info: [{"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Instance network_info: |[{"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] Acquired lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:32:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Refreshing network info cache for port cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:32:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updated VIF entry in instance network info cache for port cb65da92-dce7-42ba-9cd5-74e1dd77e147. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:32:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updating instance_info_cache with network_info: [{"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8441577d-51e0-4e20-8297-60cad7ab62b4 req-34bf7e92-3316-4d41-a824-8e93a229fa92 service nova] Releasing lock "refresh_cache-63440a76-8462-4c3e-ad9a-7cccc8c76d69" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:32:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.utils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62084569-a7f4-497f-a822-155cf4141d39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7051b427-11f5-4d69-8336-6e97f2728267]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9caed-76e3-4bec-9406-25b6892292b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd186fc-e3e0-48e9-ad9a-ad33e9bb0e97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:32:49 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:32:49 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[771d7be9-08fa-4cf8-ab59-a023e003f65b]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG os_brick.utils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:32:49 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updating existing volume attachment record: 2971904a-c5e7-459d-ab27-4b50409f26bc {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:32:50 user nova-compute[74701]: INFO nova.compute.manager [None req-6149a271-6b97-4b53-a5c4-fcea92e933ac tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Get console output
Oct 20 13:32:50 user nova-compute[74701]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'info_cache' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:32:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance destroyed successfully.
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'resources' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG os_vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc61d81-ae, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13351498-3175-4184-9ee7-9f27b8564b2e) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:52 user nova-compute[74701]: INFO os_vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start _get_guest_xml network_info=[{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:52 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:32:52 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:32:52 user nova-compute[74701]:   <uuid>8e32bfa5-4d85-409b-95f7-05f8bab18414</uuid>
Oct 20 13:32:52 user nova-compute[74701]:   <name>instance-00000025</name>
Oct 20 13:32:52 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:32:52 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:32:52 user nova-compute[74701]:   <metadata>
Oct 20 13:32:52 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:32:52 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeTestJSON-server-1501582274</nova:name>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:32:52</nova:creationTime>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:32:52 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:32:52 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:owner>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:user uuid="037a86ef21bf4b58874c1ce851f51ae6">tempest-AttachVolumeTestJSON-117323651-project-member</nova:user>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:project uuid="2eef02ee91884642a3c6612d54890923">tempest-AttachVolumeTestJSON-117323651</nova:project>
Oct 20 13:32:52 user nova-compute[74701]:       </nova:owner>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:32:52 user nova-compute[74701]:       <nova:ports>
Oct 20 13:32:52 user nova-compute[74701]:         <nova:port uuid="7bc61d81-aed3-4a1d-8243-1affa2da3280">
Oct 20 13:32:52 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:32:52 user nova-compute[74701]:         </nova:port>
Oct 20 13:32:52 user nova-compute[74701]:       </nova:ports>
Oct 20 13:32:52 user nova-compute[74701]:     </nova:instance>
Oct 20 13:32:52 user nova-compute[74701]:   </metadata>
Oct 20 13:32:52 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:32:52 user nova-compute[74701]:     <system>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="serial">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="uuid">8e32bfa5-4d85-409b-95f7-05f8bab18414</entry>
Oct 20 13:32:52 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:32:52 user nova-compute[74701]:     </system>
Oct 20 13:32:52 user nova-compute[74701]:   </sysinfo>
Oct 20 13:32:52 user nova-compute[74701]:   <os>
Oct 20 13:32:52 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:32:52 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:32:52 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:32:52 user nova-compute[74701]:   </os>
Oct 20 13:32:52 user nova-compute[74701]:   <features>
Oct 20 13:32:52 user nova-compute[74701]:     <acpi/>
Oct 20 13:32:52 user nova-compute[74701]:     <apic/>
Oct 20 13:32:52 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:32:52 user nova-compute[74701]:   </features>
Oct 20 13:32:52 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:32:52 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:32:52 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:32:52 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:32:52 user nova-compute[74701]:   </clock>
Oct 20 13:32:52 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:32:52 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:32:52 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:32:52 user nova-compute[74701]:   </cpu>
Oct 20 13:32:52 user nova-compute[74701]:   <devices>
Oct 20 13:32:52 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:32:52 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:32:52 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk"/>
Oct 20 13:32:52 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:32:52 user nova-compute[74701]:     </disk>
Oct 20 13:32:52 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:32:52 user nova-compute[74701]:       <mac address="fa:16:3e:f5:d0:67"/>
Oct 20 13:32:52 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:32:52 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:32:52 user nova-compute[74701]:       <target dev="tap7bc61d81-ae"/>
Oct 20 13:32:52 user nova-compute[74701]:     </interface>
Oct 20 13:32:52 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:32:52 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/console.log" append="off"/>
Oct 20 13:32:52 user nova-compute[74701]:     </serial>
Oct 20 13:32:52 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:32:52 user nova-compute[74701]:     <video>
Oct 20 13:32:52 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:32:52 user nova-compute[74701]:     </video>
Oct 20 13:32:52 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:32:52 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:32:52 user nova-compute[74701]:     </rng>
Oct 20 13:32:52 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:32:52 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:32:52 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:32:52 user nova-compute[74701]:     </memballoon>
Oct 20 13:32:52 user nova-compute[74701]:   </devices>
Oct 20 13:32:52 user nova-compute[74701]: </domain>
Oct 20 13:32:52 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Cannot resize image /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'migration_context' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.objects.base [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Object Instance<8e32bfa5-4d85-409b-95f7-05f8bab18414> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG os_vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b05c3f81-abb8-524b-bdef-d0af116c90a2', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc61d81-ae, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bc61d81-ae, col_values=(('qos', UUID('7650927f-c1a9-4f43-8043-ec92ed7cd2a2')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bc61d81-ae, col_values=(('external_ids', {'iface-id': '7bc61d81-aed3-4a1d-8243-1affa2da3280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d0:67', 'vm-uuid': '8e32bfa5-4d85-409b-95f7-05f8bab18414'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:32:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:53 user nova-compute[74701]: INFO os_vif [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:32:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:32:55 user nova-compute[74701]: WARNING nova.compute.manager [req-b5b1bf63-1d19-4849-a939-8913bb5d136e req-26c3f38f-ed3b-4911-b469-cf437261a8ee service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state stopped and task_state powering-on.
Oct 20 13:32:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:32:56 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance rebooted successfully.
Oct 20 13:32:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-eaaf5d7d-25cd-4233-894e-eabf8b9304d2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:32:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:32:57 user nova-compute[74701]: WARNING nova.compute.manager [req-7d005dcb-0134-4f85-97d9-22288c429c5b req-f1ef86eb-8ba5-4bc9-b5de-b7b09968bb90 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state active and task_state None.
Oct 20 13:32:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:02 user nova-compute[74701]: WARNING nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Oct 20 13:33:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 581e2c46-293f-40a8-90bc-44188395eaba {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 63440a76-8462-4c3e-ad9a-7cccc8c76d69 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "581e2c46-293f-40a8-90bc-44188395eaba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "581e2c46-293f-40a8-90bc-44188395eaba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:33:10 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:33:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.98891830444336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 581e2c46-293f-40a8-90bc-44188395eaba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 63440a76-8462-4c3e-ad9a-7cccc8c76d69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:33:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:33:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:33:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:33:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:15 user nova-compute[74701]: INFO nova.compute.manager [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attaching volume 995bbd03-ea84-4366-82f5-81e2ce449497 to /dev/vdb
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.utils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[624810e3-b899-4590-a31d-7a18ed5de826]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4276664-afcf-4e3e-bbf4-21b3d03a6db5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f2f4f-08fd-42f5-b6a6-201d4b049db8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0eb3a-67d1-40b7-b075-757486f24557]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [{"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:33:15 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361f454-23bc-4571-9774-60e7be8806d4]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG os_brick.utils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating existing volume attachment record: 14f6157f-05db-4631-92d1-1f44e6de6cce {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-8e32bfa5-4d85-409b-95f7-05f8bab18414" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:33:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:33:27 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Creating image(s)
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Ensure instance console log exists: /opt/stack/data/nova/instances/63440a76-8462-4c3e-ad9a-7cccc8c76d69/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Start _get_guest_xml network_info=[{"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alBwfetb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63440a76-8462-4c3e-ad9a-7cccc8c76d69', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0ff38a4-2727-4d15-958a-be35ea2a9af4', 'serial': 'd0ff38a4-2727-4d15-958a-be35ea2a9af4'}, 'attachment_id': '2971904a-c5e7-459d-ab27-4b50409f26bc', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:33:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:33:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alBwfetb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:33:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:27 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:27 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf926b3-67ea-4993-b7c8-6182737aa3b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:33:27 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cecef94-6804-419a-af7d-9ddc3802accd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4] added
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2a58b-6e1b-4d6e-8fce-914109bec53b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[694a2bd7-46fd-4e15-aa92-c1bc395b2115]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alBwfetb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alBwfetb" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faacfd0-6ba9-49d7-8b1a-0859fb7aa132]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'alBwfetb'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423ca39-232a-4bc7-a8c0-99bdd9d200ca]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[65faad90-6774-4bf4-89d9-92bd7c441fe7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[39245bd9-9cf0-49d0-9e16-a58de760d474]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260]
Oct 20 13:33:27 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260] successful.
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[852fb18f-3366-4f5b-9562-86318113ad2e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07138d-eb48-48f8-b4e4-99b7b71a6a07]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:27 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:27 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:27 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f13a2e-d262-440d-8709-10380edb45f0]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:27 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alBwfetb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26533623630396436', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533623630396436', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1725149587',display_name='tempest-TestVolumeBootPattern-server-1725149587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1725149587',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-n0vnmscb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:32:44Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=63440a76-8462-4c3e-ad9a-7cccc8c76d69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid 63440a76-8462-4c3e-ad9a-7cccc8c76d69 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:33:28 user nova-compute[74701]:   <uuid>63440a76-8462-4c3e-ad9a-7cccc8c76d69</uuid>
Oct 20 13:33:28 user nova-compute[74701]:   <name>instance-0000002b</name>
Oct 20 13:33:28 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:33:28 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:33:28 user nova-compute[74701]:   <metadata>
Oct 20 13:33:28 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:33:28 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:33:28 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-server-1725149587</nova:name>
Oct 20 13:33:28 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:33:27</nova:creationTime>
Oct 20 13:33:28 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:33:28 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:33:28 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:33:28 user nova-compute[74701]:       <nova:owner>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:33:28 user nova-compute[74701]:       </nova:owner>
Oct 20 13:33:28 user nova-compute[74701]:       <nova:ports>
Oct 20 13:33:28 user nova-compute[74701]:         <nova:port uuid="cb65da92-dce7-42ba-9cd5-74e1dd77e147">
Oct 20 13:33:28 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:33:28 user nova-compute[74701]:         </nova:port>
Oct 20 13:33:28 user nova-compute[74701]:       </nova:ports>
Oct 20 13:33:28 user nova-compute[74701]:     </nova:instance>
Oct 20 13:33:28 user nova-compute[74701]:   </metadata>
Oct 20 13:33:28 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:33:28 user nova-compute[74701]:     <system>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="serial">63440a76-8462-4c3e-ad9a-7cccc8c76d69</entry>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="uuid">63440a76-8462-4c3e-ad9a-7cccc8c76d69</entry>
Oct 20 13:33:28 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:33:28 user nova-compute[74701]:     </system>
Oct 20 13:33:28 user nova-compute[74701]:   </sysinfo>
Oct 20 13:33:28 user nova-compute[74701]:   <os>
Oct 20 13:33:28 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:33:28 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:33:28 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:33:28 user nova-compute[74701]:   </os>
Oct 20 13:33:28 user nova-compute[74701]:   <features>
Oct 20 13:33:28 user nova-compute[74701]:     <acpi/>
Oct 20 13:33:28 user nova-compute[74701]:     <apic/>
Oct 20 13:33:28 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:33:28 user nova-compute[74701]:   </features>
Oct 20 13:33:28 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:33:28 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:33:28 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:33:28 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:33:28 user nova-compute[74701]:   </clock>
Oct 20 13:33:28 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:33:28 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:33:28 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:33:28 user nova-compute[74701]:   </cpu>
Oct 20 13:33:28 user nova-compute[74701]:   <devices>
Oct 20 13:33:28 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:33:28 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:33:28 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:33:28 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:33:28 user nova-compute[74701]:       <serial>d0ff38a4-2727-4d15-958a-be35ea2a9af4</serial>
Oct 20 13:33:28 user nova-compute[74701]:     </disk>
Oct 20 13:33:28 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:33:28 user nova-compute[74701]:       <mac address="fa:16:3e:01:d0:ed"/>
Oct 20 13:33:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:33:28 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:33:28 user nova-compute[74701]:       <target dev="tapcb65da92-dc"/>
Oct 20 13:33:28 user nova-compute[74701]:     </interface>
Oct 20 13:33:28 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:33:28 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/63440a76-8462-4c3e-ad9a-7cccc8c76d69/console.log" append="off"/>
Oct 20 13:33:28 user nova-compute[74701]:     </serial>
Oct 20 13:33:28 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:33:28 user nova-compute[74701]:     <video>
Oct 20 13:33:28 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:33:28 user nova-compute[74701]:     </video>
Oct 20 13:33:28 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:33:28 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:33:28 user nova-compute[74701]:     </rng>
Oct 20 13:33:28 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:33:28 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:33:28 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:33:28 user nova-compute[74701]:     </memballoon>
Oct 20 13:33:28 user nova-compute[74701]:   </devices>
Oct 20 13:33:28 user nova-compute[74701]: </domain>
Oct 20 13:33:28 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1725149587',display_name='tempest-TestVolumeBootPattern-server-1725149587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1725149587',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-n0vnmscb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:32:44Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=63440a76-8462-4c3e-ad9a-7cccc8c76d69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG os_vif [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32d096b2-7ed8-56f6-b2ea-c4383aa8cd44', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb65da92-dc, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb65da92-dc, col_values=(('qos', UUID('ac9dc0c2-f0a7-48f9-91fd-53bcb0b11d47')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb65da92-dc, col_values=(('external_ids', {'iface-id': 'cb65da92-dce7-42ba-9cd5-74e1dd77e147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:d0:ed', 'vm-uuid': '63440a76-8462-4c3e-ad9a-7cccc8c76d69'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:28 user nova-compute[74701]: INFO os_vif [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc')
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:33:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:01:d0:ed, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:33:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] No waiting events found dispatching network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:33:30 user nova-compute[74701]: WARNING nova.compute.manager [req-9cf5da97-719a-4d2a-b049-0deda332240b req-c9b600d2-57f5-461e-bdc8-7ac2c196ac0e service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received unexpected event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 for instance with vm_state building and task_state spawning.
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] No waiting events found dispatching network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:33:32 user nova-compute[74701]: WARNING nova.compute.manager [req-eb1ffd4a-07c6-4fdc-bec5-ab861c59ccb7 req-dca0fea3-dbe6-4d05-8a75-829450715217 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received unexpected event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 for instance with vm_state building and task_state spawning.
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:33:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Instance spawned successfully.
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:33:32 user nova-compute[74701]: INFO nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoDsJmXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:33:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:32 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:32 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b9de4-9df1-4f54-82c9-7336c1bdf0aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:33:32 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6c5f3b-89b7-468a-b6c3-17e9e23f0f31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497] added
Oct 20 13:33:32 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:32 user nova-compute[74701]: INFO nova.compute.manager [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Took 49.82 seconds to build instance.
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9d727934-af07-48fb-96d8-40644840084e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.922s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 30.760s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:32 user nova-compute[74701]: INFO nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06019b-731d-488f-a02a-f34bd57012ce]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc6f8b-1c6e-47d7-9396-8e1a93f47978]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoDsJmXq {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoDsJmXq" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b4a748-d89b-4041-b1fa-8be1360cc326]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HoDsJmXq'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bad1ca-db7b-4f00-a499-dd2ae17e8baa]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed01f8-3b45-4fbb-b85c-3727acab77ee]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc1e8a-be05-4b34-abbd-9ab591f2c11c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260]
Oct 20 13:33:33 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260] successful.
Oct 20 13:33:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b357a-675d-4fa1-a334-c695ce575ba2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c6a60-b8a9-484b-b2df-51d8e24b84ab]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:33 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05747bb-6fbe-4d30-9cd7-6a60ed38ab27]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoDsJmXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:33:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26265363864343835', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265363864343835', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:33:34 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:33:34 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:33:34 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:33:34 user nova-compute[74701]:   <serial>995bbd03-ea84-4366-82f5-81e2ce449497</serial>
Oct 20 13:33:34 user nova-compute[74701]: </disk>
Oct 20 13:33:34 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No VIF found with MAC fa:16:3e:c1:78:65, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:33:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-a5e18184-8684-464f-9b11-9dddd79d576c tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.750s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:37 user nova-compute[74701]: INFO nova.compute.manager [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Detaching volume 995bbd03-ea84-4366-82f5-81e2ce449497
Oct 20 13:33:37 user nova-compute[74701]: INFO nova.virt.block_device [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attempting to driver detach volume 995bbd03-ea84-4366-82f5-81e2ce449497 from mountpoint /dev/vdb
Oct 20 13:33:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Attempting to detach device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:33:37 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:33:37 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:33:37 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:33:37 user nova-compute[74701]:   <serial>995bbd03-ea84-4366-82f5-81e2ce449497</serial>
Oct 20 13:33:37 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:33:37 user nova-compute[74701]: </disk>
Oct 20 13:33:37 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:33:37 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config.
Oct 20 13:33:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:33:37 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:33:37 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:33:37 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:33:37 user nova-compute[74701]:   <serial>995bbd03-ea84-4366-82f5-81e2ce449497</serial>
Oct 20 13:33:37 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:33:37 user nova-compute[74701]: </disk>
Oct 20 13:33:37 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:33:37 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:33:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:33:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:51 user nova-compute[74701]: INFO nova.compute.manager [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Terminating instance
Oct 20 13:33:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-82258e2a-c674-40a0-87fb-80a119f11a24 req-4a262048-d227-42f1-8bec-97f22c5989de service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-unplugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Instance destroyed successfully.
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'resources' on Instance uuid 581e2c46-293f-40a8-90bc-44188395eaba {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-470408425',display_name='tempest-ServerActionsTestOtherA-server-470408425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-470408425',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-2umz71vo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=581e2c46-293f-40a8-90bc-44188395eaba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "address": "fa:16:3e:bc:56:e6", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped74ca21-24", "ovs_interfaceid": "ed74ca21-24c2-4479-8d07-971fc22f3b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_vif [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped74ca21-24, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=272a5cbe-d8d3-44ca-8240-8ab527a637d7) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:52 user nova-compute[74701]: INFO os_vif [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:56:e6,bridge_name='br-int',has_traffic_filtering=True,id=ed74ca21-24c2-4479-8d07-971fc22f3b29,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped74ca21-24')
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTHUPWro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:33:52 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f730219-3db9-4868-a237-f9ef1f2da1c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:33:52 user nova-compute[74701]: No targets found.
Oct 20 13:33:52 user nova-compute[74701]: iSNS:
Oct 20 13:33:52 user nova-compute[74701]: No targets found.
Oct 20 13:33:52 user nova-compute[74701]: STATIC:
Oct 20 13:33:52 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd
Oct 20 13:33:52 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:33:52 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:33:52 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497
Oct 20 13:33:52 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:33:52 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:33:52 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4
Oct 20 13:33:52 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:33:52 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:33:52 user nova-compute[74701]: FIRMWARE:
Oct 20 13:33:52 user nova-compute[74701]: No targets found.
Oct 20 13:33:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:33:52 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:33:52 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb886b57-2692-4a9f-951c-1455a57071a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68382f49-0108-429e-87fb-b918f70f6376]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:52 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:52 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd (non-flash)
Oct 20 13:33:52 user nova-compute[74701]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:52 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc787130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5721f8b-b9fa-42a7-b157-baaa9c1a3d62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0a818-da7e-48c3-91f6-6fc38dba790b]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d080d-1469-4acf-8264-3fcc70b86fba]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4745c9-9a6d-41a1-a1a6-a5d0f71618f6]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23264356239663233', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d454d6b', '/dev/disk/by-id/scsi-1SCST_BIO4d454d6b-2d5b9f23baf4c84d') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e174d852-5f9a-41db-aab7-e0ef5ff61223]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bde70a-3e2c-46e9-8719-a464b71508f6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1777a-5f39-4a56-92c7-93db41cb0a93]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260]
Oct 20 13:33:52 user nova-compute[74701]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd, portal: 172.16.0.220,3260] successful.
Oct 20 13:33:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce40ae-cd58-4f39-963a-471dbd89f1d8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] <== disconnect_volume: return (323ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:33:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Deleting instance files /opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba_del
Oct 20 13:33:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Deletion of /opt/stack/data/nova/instances/581e2c46-293f-40a8-90bc-44188395eaba_del complete
Oct 20 13:33:52 user nova-compute[74701]: INFO nova.compute.manager [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 20 13:33:52 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:33:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:33:53 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:33:53 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Took 0.87 seconds to deallocate network for instance.
Oct 20 13:33:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:33:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] Acquiring lock "581e2c46-293f-40a8-90bc-44188395eaba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] Lock "581e2c46-293f-40a8-90bc-44188395eaba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] No waiting events found dispatching network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:33:53 user nova-compute[74701]: WARNING nova.compute.manager [req-35cfd2c8-4fb1-4dcf-80da-15b737ae8923 req-fa8ea608-51d7-40af-bd13-7b34ac20ca17 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received unexpected event network-vif-plugged-ed74ca21-24c2-4479-8d07-971fc22f3b29 for instance with vm_state active and task_state deleting.
Oct 20 13:33:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-4108f91d-ee6f-4a35-9fb3-3fc91a94e4c7 req-a4c298c5-b8d9-411c-a3bb-faa3b5618985 service nova] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Received event network-vif-deleted-ed74ca21-24c2-4479-8d07-971fc22f3b29 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:33:54 user nova-compute[74701]: INFO nova.compute.manager [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Took 0.94 seconds to detach 1 volumes for instance.
Oct 20 13:33:54 user nova-compute[74701]: DEBUG nova.compute.manager [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 581e2c46-293f-40a8-90bc-44188395eaba] Deleting volume: e31f21d8-7f1c-4d03-a675-0e6b2a2c05dd {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:33:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:33:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:33:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:33:55 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:33:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:55 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Deleted allocations for instance 581e2c46-293f-40a8-90bc-44188395eaba
Oct 20 13:33:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9c5dd19-5708-4489-b888-35bf42c84351 tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "581e2c46-293f-40a8-90bc-44188395eaba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.662s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:33:57 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 is timed out.
Oct 20 13:33:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config.
Oct 20 13:33:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoDsJmXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:33:57 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e6ecd-60f4-442d-bba6-cd7e935af7c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:33:57 user nova-compute[74701]: No targets found.
Oct 20 13:33:57 user nova-compute[74701]: iSNS:
Oct 20 13:33:57 user nova-compute[74701]: No targets found.
Oct 20 13:33:57 user nova-compute[74701]: STATIC:
Oct 20 13:33:57 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497
Oct 20 13:33:57 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:33:57 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:33:57 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4
Oct 20 13:33:57 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:33:57 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:33:57 user nova-compute[74701]: FIRMWARE:
Oct 20 13:33:57 user nova-compute[74701]: No targets found.
Oct 20 13:33:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:33:57 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:33:57 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ac24c5-dca1-4b75-bf70-17a80cc8b1a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[695fa746-161b-4976-83c6-26dc0e5d0390]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:57 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:33:57 user nova-compute[74701]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 (non-flash)
Oct 20 13:33:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e01c57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f071940-c0cf-4ddf-81d1-49044669c4ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6467cf1-b776-4240-b374-1cb611647797]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4737c-c706-489c-9c9f-9547a0c5102e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:33:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9bd12d-d626-486a-a385-0ca89581c579]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f4e35f-6a28-4c41-ba40-f7b9b81a0645]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76800bc-72d8-4c43-9b3f-89b7ec86880d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260]
Oct 20 13:33:58 user nova-compute[74701]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497, portal: 172.16.0.220,3260] successful.
Oct 20 13:33:58 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:995bbd03-ea84-4366-82f5-81e2ce449497 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38f912e-4e69-49d7-9b88-7935752357b6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== disconnect_volume: return (303ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:33:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7b5e5931-7fbc-45c9-ba1b-d4793fea808a tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:34:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:34:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=24.977745056152344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 63440a76-8462-4c3e-ad9a-7cccc8c76d69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:34:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:16 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:16 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:34:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:34:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:34:16 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:34:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:34:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:32 user nova-compute[74701]: INFO nova.compute.manager [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attaching volume de4a3d13-383f-4275-9854-a2479b869659 to /dev/vdb
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.utils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[814cfab8-9ed5-4101-9c9c-31b304ed8334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d262e6-f1a7-44a8-8ffa-0af0ddcb1aad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee693022-74c0-46fe-a0f9-61cb340de3ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dcf1c4-8363-4f17-93ad-02a0f3242fd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:34:32 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:34:32 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1915b-e8ff-4a20-9e95-c822bf21884f]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG os_brick.utils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:34:32 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating existing volume attachment record: e363a267-ed30-4a43-8edc-be7699ccac60 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:34:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:43 user nova-compute[74701]: INFO nova.compute.manager [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Terminating instance
Oct 20 13:34:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.compute.manager [req-eec8ac93-487e-42b9-bdaa-7a554d8a1cb6 req-6069cc72-889a-406c-98e7-a9bdab4beea3 service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-unplugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:34:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Instance destroyed successfully.
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.objects.instance [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'resources' on Instance uuid 8e32bfa5-4d85-409b-95f7-05f8bab18414 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1501582274',display_name='tempest-AttachVolumeTestJSON-server-1501582274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1501582274',id=37,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDREZgrqAerhfBjKxt0mNqgChvFQg3wjlSGnKaOhUL/DXBWk7yCnSZHUaymyHkYSe3HPa8rJacBFPi86eigIwqnIWnit5MwclmXfliLLMsyo9IXKtEROfG/jay02D4jKUQ==',key_name='tempest-keypair-250371152',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-irwaktzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=8e32bfa5-4d85-409b-95f7-05f8bab18414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "address": "fa:16:3e:f5:d0:67", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc61d81-ae", "ovs_interfaceid": "7bc61d81-aed3-4a1d-8243-1affa2da3280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG os_vif [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc61d81-ae, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7650927f-c1a9-4f43-8043-ec92ed7cd2a2) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:34:44 user nova-compute[74701]: INFO os_vif [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:d0:67,bridge_name='br-int',has_traffic_filtering=True,id=7bc61d81-aed3-4a1d-8243-1affa2da3280,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc61d81-ae')
Oct 20 13:34:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Deleting instance files /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414_del
Oct 20 13:34:44 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Deletion of /opt/stack/data/nova/instances/8e32bfa5-4d85-409b-95f7-05f8bab18414_del complete
Oct 20 13:34:44 user nova-compute[74701]: INFO nova.compute.manager [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 13:34:44 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:34:44 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:34:45 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:34:45 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Took 1.45 seconds to deallocate network for instance.
Oct 20 13:34:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-0fc3ee7b-0122-4ac4-94aa-5a9999e2a4cb req-fd83006d-1b3b-4575-b1b9-8153cd457f1f service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-deleted-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:45 user nova-compute[74701]: INFO nova.compute.manager [req-0fc3ee7b-0122-4ac4-94aa-5a9999e2a4cb req-fd83006d-1b3b-4575-b1b9-8153cd457f1f service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Neutron deleted interface 7bc61d81-aed3-4a1d-8243-1affa2da3280; detaching it from the instance and deleting it from the info cache
Oct 20 13:34:45 user nova-compute[74701]: DEBUG nova.network.neutron [req-0fc3ee7b-0122-4ac4-94aa-5a9999e2a4cb req-fd83006d-1b3b-4575-b1b9-8153cd457f1f service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:34:45 user nova-compute[74701]: DEBUG nova.compute.manager [req-0fc3ee7b-0122-4ac4-94aa-5a9999e2a4cb req-fd83006d-1b3b-4575-b1b9-8153cd457f1f service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Detach interface failed, port_id=7bc61d81-aed3-4a1d-8243-1affa2da3280, reason: Instance 8e32bfa5-4d85-409b-95f7-05f8bab18414 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:34:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:46 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Deleted allocations for instance 8e32bfa5-4d85-409b-95f7-05f8bab18414
Oct 20 13:34:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] Acquiring lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] No waiting events found dispatching network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:34:46 user nova-compute[74701]: WARNING nova.compute.manager [req-358550e5-be52-44f1-92bd-564592d906fc req-864892e0-0048-4fff-be1d-812c2203f78a service nova] [instance: 8e32bfa5-4d85-409b-95f7-05f8bab18414] Received unexpected event network-vif-plugged-7bc61d81-aed3-4a1d-8243-1affa2da3280 for instance with vm_state deleted and task_state None.
Oct 20 13:34:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-f017aa27-5290-42a9-95b5-8991524ea1e3 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "8e32bfa5-4d85-409b-95f7-05f8bab18414" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.810s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPHFfOAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:34:50 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:34:50 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:34:50 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[743bea06-9e65-40b3-88a4-62358b4c18ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:34:50 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d47753-0c87-4aef-85f0-da55ac57d8fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659] added
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e40f44-7f82-4d78-86e2-7e881d5670ef]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc7f49c-851a-4010-8530-b30a30ad8a99]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPHFfOAZ {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPHFfOAZ" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f28d6-a89d-435f-90d8-612e769c5153]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPHFfOAZ'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[271fa46c-2361-4de0-96c6-ef29fad4848e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff974f4-f85c-453a-8276-01da6f5ef5b3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836b3c2-6763-412d-8d10-c7aaf46a520f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260]
Oct 20 13:34:50 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260] successful.
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc09a1-cb58-4b74-b846-af83770c4cd7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e531938-553c-4609-989b-af55a0074958]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)
Oct 20 13:34:50 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab959a-009f-47b4-bd32-4d8f922605ed]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:34:50 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPHFfOAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23166316661326662', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166316661326662', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG nova.objects.instance [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:34:51 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:34:51 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:34:51 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:34:51 user nova-compute[74701]:   <serial>de4a3d13-383f-4275-9854-a2479b869659</serial>
Oct 20 13:34:51 user nova-compute[74701]: </disk>
Oct 20 13:34:51 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:51 user nova-compute[74701]: INFO nova.compute.manager [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Terminating instance
Oct 20 13:34:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] No VIF found with MAC fa:16:3e:c1:78:65, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-c9ea5bc6-58c4-404f-af58-64cf00d285db tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.742s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Instance destroyed successfully.
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lazy-loading 'resources' on Instance uuid 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-522447729',display_name='tempest-ServerActionsTestOtherA-server-522447729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-522447729',id=21,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ETFNauLofzcbedAWk6PulRddp8NhyExqxhwVFy1/2aaV0bx+n9DxS+lHtAUafCms0ZQ+1I+Zv0VZcQFc3BvxWaodVx+O4JDQBh3G/TL/rJtW+snFO/Q63hnTNTiB6BA==',key_name='tempest-keypair-1307136197',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0182e44f51fb425c8cd560e7a42da61f',ramdisk_id='',reservation_id='r-mkql2vhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1694438458',owner_user_name='tempest-ServerActionsTestOtherA-1694438458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9189507d4d4f4faeb52d1f6b1fcb17d8',uuid=08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converting VIF {"id": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "address": "fa:16:3e:08:a4:ab", "network": {"id": "01d96817-f00e-4526-858f-29ea0733cfeb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-299887580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0182e44f51fb425c8cd560e7a42da61f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddb50c3-5a", "ovs_interfaceid": "fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG os_vif [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfddb50c3-5a, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=022a9c6e-3358-4a1f-ac1f-0ab040729e0c) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:52 user nova-compute[74701]: INFO os_vif [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:a4:ab,bridge_name='br-int',has_traffic_filtering=True,id=fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f,network=Network(01d96817-f00e-4526-858f-29ea0733cfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddb50c3-5a')
Oct 20 13:34:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Deleting instance files /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a_del
Oct 20 13:34:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Deletion of /opt/stack/data/nova/instances/08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a_del complete
Oct 20 13:34:52 user nova-compute[74701]: INFO nova.compute.manager [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 13:34:52 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:34:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-unplugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] No waiting events found dispatching network-vif-unplugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-eae5935a-9294-4bca-9640-21095f178073 req-b44a5841-6620-4323-a2c3-9fa6e94e481f service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-unplugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:34:53 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Took 0.90 seconds to deallocate network for instance.
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-5022717b-e3f7-4bed-b3d3-c1367df850a6 req-3adac668-15ba-40cc-941d-7565a83ee1c3 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-deleted-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:34:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:54 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Deleted allocations for instance 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a
Oct 20 13:34:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1bc29d1e-a463-4f47-91f4-179d19b4182d tempest-ServerActionsTestOtherA-1694438458 tempest-ServerActionsTestOtherA-1694438458-project-member] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:54 user nova-compute[74701]: INFO nova.compute.manager [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Detaching volume de4a3d13-383f-4275-9854-a2479b869659
Oct 20 13:34:54 user nova-compute[74701]: INFO nova.virt.block_device [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Attempting to driver detach volume de4a3d13-383f-4275-9854-a2479b869659 from mountpoint /dev/vdb
Oct 20 13:34:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Attempting to detach device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:34:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:34:54 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:34:54 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:34:54 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:34:54 user nova-compute[74701]:   <serial>de4a3d13-383f-4275-9854-a2479b869659</serial>
Oct 20 13:34:54 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:34:54 user nova-compute[74701]: </disk>
Oct 20 13:34:54 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:34:54 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the persistent domain config.
Oct 20 13:34:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:34:54 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:34:54 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:34:54 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:34:54 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:34:54 user nova-compute[74701]:   <serial>de4a3d13-383f-4275-9854-a2479b869659</serial>
Oct 20 13:34:54 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:34:54 user nova-compute[74701]: </disk>
Oct 20 13:34:54 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] Acquiring lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] Lock "08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:34:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] No waiting events found dispatching network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:34:55 user nova-compute[74701]: WARNING nova.compute.manager [req-5b8f1a8f-19df-4084-bc85-8249edc23591 req-82b25313-059d-4507-98c4-c0054b4b11e3 service nova] [instance: 08664ec5-e8d9-40ca-aa6b-d9ee9c1ebf2a] Received unexpected event network-vif-plugged-fddb50c3-5aa1-4b5e-9ad5-4cef67cccd9f for instance with vm_state deleted and task_state None.
Oct 20 13:34:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:34:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:35:12 user nova-compute[74701]: INFO nova.compute.claims [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Claim successful on node user
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:35:12 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.policy [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34ba26330a2c4ca19f416307b591573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ddc21f84c429e95e17cd7018c2165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:35:12 user nova-compute[74701]: INFO nova.virt.block_device [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Booting with volume e8577724-c6ee-4b66-a2c5-6e9553023fe4 at /dev/vda
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.utils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ccc92-0116-4c95-9bfc-6c8345df10bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3759000-69f7-4659-8daa-f845bcf91391]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cccb3b-f66b-4c5f-a073-c8184d587ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[332dad0a-baa9-40e6-9367-240075edc23f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:35:12 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c8d45-e69d-49dd-810c-c5cf4fa6866e]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG os_brick.utils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating existing volume attachment record: f00bd44a-e8ab-4dec-a9f5-66bdcf7caf00 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:35:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Successfully created port: 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.030452728271484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Successfully updated port: 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing instance network info cache due to event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 63440a76-8462-4c3e-ad9a-7cccc8c76d69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2b24a52-b82a-47eb-9e47-4ca49c469fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:35:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance network_info: |[{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.network.neutron [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.network.neutron [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated VIF entry in instance network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG nova.network.neutron [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8251325f-36a0-4409-b867-f9816644d03e req-d8ab7c46-f62e-4ec3-8f02-0d4da9d1cf11 service nova] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:35:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 is timed out.
Oct 20 13:35:15 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully detached device vdb from instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 from the live domain config.
Oct 20 13:35:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPHFfOAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:35:15 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f676d5-28ca-4913-93d2-7ad4b90ddf4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:35:15 user nova-compute[74701]: No targets found.
Oct 20 13:35:15 user nova-compute[74701]: iSNS:
Oct 20 13:35:15 user nova-compute[74701]: No targets found.
Oct 20 13:35:15 user nova-compute[74701]: STATIC:
Oct 20 13:35:15 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659
Oct 20 13:35:15 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:35:15 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:35:15 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4
Oct 20 13:35:15 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:35:15 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:35:15 user nova-compute[74701]: FIRMWARE:
Oct 20 13:35:15 user nova-compute[74701]: No targets found.
Oct 20 13:35:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:35:15 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:35:15 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e242dfba-d991-41c8-9e1f-235b7144c6e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4110370-f3e4-4996-a6f2-79c405247fc8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:35:15 user nova-compute[74701]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)
Oct 20 13:35:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:35:15 user nova-compute[74701]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 (non-flash)
Oct 20 13:35:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e07afac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a9df0-84c0-41be-acd5-a3308e7ec855]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[794fd770-2a7e-4064-bcaa-00470111761e]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d0756-fd3d-4360-9ef7-2d011d58d8fc]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d64d78-64d9-4b6e-a082-bba10c7f3b97]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73fefbe-1e58-470e-81ea-a357d6962611]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a95c6-135b-4c5c-9ea1-e8e3dc261f82]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260]
Oct 20 13:35:15 user nova-compute[74701]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659, portal: 172.16.0.220,3260] successful.
Oct 20 13:35:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de4a3d13-383f-4275-9854-a2479b869659 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac491ff-9aa8-408c-a8ff-8addcf54ea8d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] <== disconnect_volume: return (307ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:35:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:35:16 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'flavor' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:35:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d40c6eb0-be68-46e6-8d6e-1848d9ab48d8 tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:23 user nova-compute[74701]: INFO nova.compute.manager [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Terminating instance
Oct 20 13:35:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:35:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-unplugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] No waiting events found dispatching network-vif-unplugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0845fe0-2ba4-4462-befe-793772158752 req-90139365-b493-4746-96f5-b021f56932b6 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-unplugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Instance destroyed successfully.
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid 63440a76-8462-4c3e-ad9a-7cccc8c76d69 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1725149587',display_name='tempest-TestVolumeBootPattern-server-1725149587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1725149587',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-n0vnmscb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:33:33Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=63440a76-8462-4c3e-ad9a-7cccc8c76d69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "address": "fa:16:3e:01:d0:ed", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb65da92-dc", "ovs_interfaceid": "cb65da92-dce7-42ba-9cd5-74e1dd77e147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_vif [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb65da92-dc, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac9dc0c2-f0a7-48f9-91fd-53bcb0b11d47) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:24 user nova-compute[74701]: INFO os_vif [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d0:ed,bridge_name='br-int',has_traffic_filtering=True,id=cb65da92-dce7-42ba-9cd5-74e1dd77e147,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb65da92-dc')
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alBwfetb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:35:24 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38289dc-d62d-4996-b1b9-2af6b546789e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:35:24 user nova-compute[74701]: No targets found.
Oct 20 13:35:24 user nova-compute[74701]: iSNS:
Oct 20 13:35:24 user nova-compute[74701]: No targets found.
Oct 20 13:35:24 user nova-compute[74701]: STATIC:
Oct 20 13:35:24 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4
Oct 20 13:35:24 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:35:24 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:35:24 user nova-compute[74701]: FIRMWARE:
Oct 20 13:35:24 user nova-compute[74701]: No targets found.
Oct 20 13:35:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:35:24 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:35:24 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd619bfa-b632-49bf-b1cc-4e13ddeaea8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d434e-be93-4deb-9cb0-ed0245bad870]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:35:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 (non-flash)
Oct 20 13:35:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc687eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c02b652-dbff-4b51-97cc-dea21b50ebe1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b564322-3b4d-41c9-9d3f-62a925fb9211]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5b8a8-ad73-48b2-b92d-5bb459cfbb01]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdf2a81-425b-451a-81e2-7e8e3dcba7b9]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9dbab40a', '/dev/disk/by-id/scsi-26533623630396436', '/dev/disk/by-id/scsi-1SCST_BIO9dbab40a-e3b609d6f281df35') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78118c92-3baf-4dbd-bf34-35d9fa5e340e]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49fd7a-bda7-4fc6-9e61-48ebe299fbce]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee1c28-24a1-42bb-976b-1c9853e25c1e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260]
Oct 20 13:35:25 user nova-compute[74701]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4, portal: 172.16.0.220,3260] successful.
Oct 20 13:35:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ff38a4-2727-4d15-958a-be35ea2a9af4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4daa3-33ef-4224-82cd-d019a4fac255]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (326ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:35:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Deleting instance files /opt/stack/data/nova/instances/63440a76-8462-4c3e-ad9a-7cccc8c76d69_del
Oct 20 13:35:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Deletion of /opt/stack/data/nova/instances/63440a76-8462-4c3e-ad9a-7cccc8c76d69_del complete
Oct 20 13:35:25 user nova-compute[74701]: INFO nova.compute.manager [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 20 13:35:25 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:25 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Took 0.45 seconds to deallocate network for instance.
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-f1fca927-2130-48fe-aed8-d440a0000a36 req-3a24f608-5d77-4178-b7ff-c3e11428d589 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-deleted-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:25 user nova-compute[74701]: INFO nova.compute.manager [req-f1fca927-2130-48fe-aed8-d440a0000a36 req-3a24f608-5d77-4178-b7ff-c3e11428d589 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Neutron deleted interface cb65da92-dce7-42ba-9cd5-74e1dd77e147; detaching it from the instance and deleting it from the info cache
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-f1fca927-2130-48fe-aed8-d440a0000a36 req-3a24f608-5d77-4178-b7ff-c3e11428d589 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-f1fca927-2130-48fe-aed8-d440a0000a36 req-3a24f608-5d77-4178-b7ff-c3e11428d589 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Detach interface failed, port_id=cb65da92-dce7-42ba-9cd5-74e1dd77e147, reason: Instance 63440a76-8462-4c3e-ad9a-7cccc8c76d69 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] Acquiring lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] No waiting events found dispatching network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:26 user nova-compute[74701]: WARNING nova.compute.manager [req-a883a799-812d-4e7e-9f73-80778266e670 req-7eebb3f0-dafc-44cf-8ea5-c894b00281e7 service nova] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Received unexpected event network-vif-plugged-cb65da92-dce7-42ba-9cd5-74e1dd77e147 for instance with vm_state active and task_state deleting.
Oct 20 13:35:26 user nova-compute[74701]: INFO nova.compute.manager [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Took 0.79 seconds to detach 1 volumes for instance.
Oct 20 13:35:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 63440a76-8462-4c3e-ad9a-7cccc8c76d69] Deleting volume: d0ff38a4-2727-4d15-958a-be35ea2a9af4 {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:26 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance 63440a76-8462-4c3e-ad9a-7cccc8c76d69
Oct 20 13:35:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9ac145c2-70f0-4af8-99d8-d33ee4287601 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "63440a76-8462-4c3e-ad9a-7cccc8c76d69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:35:29 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Creating image(s)
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start _get_guest_xml network_info=[{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2b24a52-b82a-47eb-9e47-4ca49c469fff', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'serial': 'e8577724-c6ee-4b66-a2c5-6e9553023fe4'}, 'attachment_id': 'f00bd44a-e8ab-4dec-a9f5-66bdcf7caf00', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:35:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:35:29 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:35:29 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:35:29 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db3985b-3134-473c-84ee-71d78bf2c685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:35:29 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372e4fd-b81f-4045-b5d3-9def19a96fd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4] added
Oct 20 13:35:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da38d1-a6f7-411c-ab02-31b634167c9d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[66134679-250b-483b-a77f-b93037abdff4]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGytrsjS {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGytrsjS" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac904a7-1473-4e37-bb66-f6c6d31a0e0d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGytrsjS'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a442dbd-7abc-4125-b9cd-23e5b29e7831]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ea80af-51a9-4390-9b80-b0bd6bc6667a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:35:29 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:35:29 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:35:29 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:35:29 user nova-compute[74701]: 
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb21dec-fc72-4b1b-aaaf-79a07f486cf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]
Oct 20 13:35:29 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.
Oct 20 13:35:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a4ae16-f192-4527-9ed2-199c06e59c29]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043755c-3176-4d8a-bc5e-20b24a68446d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:35:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:35:29 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[65964734-67dd-40db-852a-5fc0942eca1d]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:35:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26336326531313365', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336326531313365', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsq2RFUZmY7N4rDyg+VaerPnVzQAw6GID09vF4haNySWIqs830c3htSUZrpLOLrzLcX7dLzE3hoZddsP9lVm24nXOZZlBCv0oqwG3xZiuOSYal0TAYOyeVINHd484OsUA==',key_name='tempest-TestShelveInstance-581037021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:35:12Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.objects.instance [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:35:30 user nova-compute[74701]:   <uuid>f2b24a52-b82a-47eb-9e47-4ca49c469fff</uuid>
Oct 20 13:35:30 user nova-compute[74701]:   <name>instance-0000002c</name>
Oct 20 13:35:30 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:35:30 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:35:30 user nova-compute[74701]:   <metadata>
Oct 20 13:35:30 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:35:30 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:35:30 user nova-compute[74701]:       <nova:name>tempest-TestShelveInstance-server-1770888340</nova:name>
Oct 20 13:35:30 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:35:29</nova:creationTime>
Oct 20 13:35:30 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:35:30 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:35:30 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:35:30 user nova-compute[74701]:       <nova:owner>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:user uuid="34ba26330a2c4ca19f416307b591573d">tempest-TestShelveInstance-2036929292-project-member</nova:user>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:project uuid="c00ddc21f84c429e95e17cd7018c2165">tempest-TestShelveInstance-2036929292</nova:project>
Oct 20 13:35:30 user nova-compute[74701]:       </nova:owner>
Oct 20 13:35:30 user nova-compute[74701]:       <nova:ports>
Oct 20 13:35:30 user nova-compute[74701]:         <nova:port uuid="82afa982-0b78-4dd5-ba34-883b7de5204f">
Oct 20 13:35:30 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:35:30 user nova-compute[74701]:         </nova:port>
Oct 20 13:35:30 user nova-compute[74701]:       </nova:ports>
Oct 20 13:35:30 user nova-compute[74701]:     </nova:instance>
Oct 20 13:35:30 user nova-compute[74701]:   </metadata>
Oct 20 13:35:30 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:35:30 user nova-compute[74701]:     <system>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="serial">f2b24a52-b82a-47eb-9e47-4ca49c469fff</entry>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="uuid">f2b24a52-b82a-47eb-9e47-4ca49c469fff</entry>
Oct 20 13:35:30 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:35:30 user nova-compute[74701]:     </system>
Oct 20 13:35:30 user nova-compute[74701]:   </sysinfo>
Oct 20 13:35:30 user nova-compute[74701]:   <os>
Oct 20 13:35:30 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:35:30 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:35:30 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:35:30 user nova-compute[74701]:   </os>
Oct 20 13:35:30 user nova-compute[74701]:   <features>
Oct 20 13:35:30 user nova-compute[74701]:     <acpi/>
Oct 20 13:35:30 user nova-compute[74701]:     <apic/>
Oct 20 13:35:30 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:35:30 user nova-compute[74701]:   </features>
Oct 20 13:35:30 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:35:30 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:35:30 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:35:30 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:35:30 user nova-compute[74701]:   </clock>
Oct 20 13:35:30 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:35:30 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:35:30 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:35:30 user nova-compute[74701]:   </cpu>
Oct 20 13:35:30 user nova-compute[74701]:   <devices>
Oct 20 13:35:30 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:35:30 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:35:30 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:35:30 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:35:30 user nova-compute[74701]:       <serial>e8577724-c6ee-4b66-a2c5-6e9553023fe4</serial>
Oct 20 13:35:30 user nova-compute[74701]:     </disk>
Oct 20 13:35:30 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:35:30 user nova-compute[74701]:       <mac address="fa:16:3e:2f:c9:af"/>
Oct 20 13:35:30 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:35:30 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:35:30 user nova-compute[74701]:       <target dev="tap82afa982-0b"/>
Oct 20 13:35:30 user nova-compute[74701]:     </interface>
Oct 20 13:35:30 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:35:30 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff/console.log" append="off"/>
Oct 20 13:35:30 user nova-compute[74701]:     </serial>
Oct 20 13:35:30 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:35:30 user nova-compute[74701]:     <video>
Oct 20 13:35:30 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:35:30 user nova-compute[74701]:     </video>
Oct 20 13:35:30 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:35:30 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:35:30 user nova-compute[74701]:     </rng>
Oct 20 13:35:30 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:35:30 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:35:30 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:35:30 user nova-compute[74701]:     </memballoon>
Oct 20 13:35:30 user nova-compute[74701]:   </devices>
Oct 20 13:35:30 user nova-compute[74701]: </domain>
Oct 20 13:35:30 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsq2RFUZmY7N4rDyg+VaerPnVzQAw6GID09vF4haNySWIqs830c3htSUZrpLOLrzLcX7dLzE3hoZddsP9lVm24nXOZZlBCv0oqwG3xZiuOSYal0TAYOyeVINHd484OsUA==',key_name='tempest-TestShelveInstance-581037021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:35:12Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG os_vif [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac9d8e15-cb35-57e0-bfe8-7e9ba0e521c6', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82afa982-0b, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82afa982-0b, col_values=(('qos', UUID('e7b967c5-d6b3-4e66-8ca3-8d823492083a')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82afa982-0b, col_values=(('external_ids', {'iface-id': '82afa982-0b78-4dd5-ba34-883b7de5204f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:c9:af', 'vm-uuid': 'f2b24a52-b82a-47eb-9e47-4ca49c469fff'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:30 user nova-compute[74701]: INFO os_vif [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b')
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:35:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] No VIF found with MAC fa:16:3e:2f:c9:af, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:31 user nova-compute[74701]: WARNING nova.compute.manager [req-9ac41dfe-ebc2-4340-aa0e-71206ef5acc9 req-df9a0909-99f8-45fe-b825-32bcbbe15db6 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state building and task_state spawning.
Oct 20 13:35:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:35:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance spawned successfully.
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:34 user nova-compute[74701]: WARNING nova.compute.manager [req-b9d07159-81f1-4c44-81e3-9373074ee8d7 req-db05cba5-a591-415d-a6d7-5705f5bd584b service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state building and task_state spawning.
Oct 20 13:35:34 user nova-compute[74701]: INFO nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Took 4.97 seconds to spawn the instance on the hypervisor.
Oct 20 13:35:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:35:34 user nova-compute[74701]: INFO nova.compute.manager [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Took 22.11 seconds to build instance.
Oct 20 13:35:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-705bdf36-ea2c-4186-a310-1b439ca76453 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.199s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:37 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:35:37 user nova-compute[74701]: INFO nova.compute.claims [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Claim successful on node user
Oct 20 13:35:37 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:35:38 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.policy [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '037a86ef21bf4b58874c1ce851f51ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eef02ee91884642a3c6612d54890923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:35:38 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Creating image(s)
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "/opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "/opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "/opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.192s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b,backing_fmt=raw /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk 1073741824" returned: 0 in 0.065s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "5b8f44f38e73dfee66f96d0062df5ad933b1d58b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Successfully created port: 1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:35:38 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Cannot resize image /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Ensure instance console log exists: /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Successfully updated port: 1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquired lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-changed-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Refreshing instance network info cache due to event network-changed-1d3a1639-4ce1-4a35-ab22-a62887b641a5. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] Acquiring lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.neutron [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Releasing lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Instance network_info: |[{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] Acquired lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.neutron [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Refreshing network info cache for port 1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Start _get_guest_xml network_info=[{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '5624a009-5482-4bf8-9162-de2cb54fd34f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:35:39 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:39 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:02:14Z,direct_url=<?>,disk_format='qcow2',id=5624a009-5482-4bf8-9162-de2cb54fd34f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3655a5a7485450ba27f28d13af59d87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1084448285',display_name='tempest-AttachVolumeTestJSON-server-1084448285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1084448285',id=45,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyI1BsriDDt1gO2NndtrGdeeyd4bInjVunwtgazba+Y+FVCSm8Kbnjv7JbQBBKBFMhVN3dXStpjXauNk+9tpfEK0YM8RcPQXSXXcAiIPAKZRvUlEDUOS7QuU0Wi2r4zHA==',key_name='tempest-keypair-1540280801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-szo2tk4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=776d8fb2-c6b3-4cb9-aa30-81e16c92d02c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.objects.instance [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'pci_devices' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:35:39 user nova-compute[74701]:   <uuid>776d8fb2-c6b3-4cb9-aa30-81e16c92d02c</uuid>
Oct 20 13:35:39 user nova-compute[74701]:   <name>instance-0000002d</name>
Oct 20 13:35:39 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:35:39 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:35:39 user nova-compute[74701]:   <metadata>
Oct 20 13:35:39 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:35:39 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:name>tempest-AttachVolumeTestJSON-server-1084448285</nova:name>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:35:39</nova:creationTime>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:35:39 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:35:39 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:owner>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:user uuid="037a86ef21bf4b58874c1ce851f51ae6">tempest-AttachVolumeTestJSON-117323651-project-member</nova:user>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:project uuid="2eef02ee91884642a3c6612d54890923">tempest-AttachVolumeTestJSON-117323651</nova:project>
Oct 20 13:35:39 user nova-compute[74701]:       </nova:owner>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:root type="image" uuid="5624a009-5482-4bf8-9162-de2cb54fd34f"/>
Oct 20 13:35:39 user nova-compute[74701]:       <nova:ports>
Oct 20 13:35:39 user nova-compute[74701]:         <nova:port uuid="1d3a1639-4ce1-4a35-ab22-a62887b641a5">
Oct 20 13:35:39 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:35:39 user nova-compute[74701]:         </nova:port>
Oct 20 13:35:39 user nova-compute[74701]:       </nova:ports>
Oct 20 13:35:39 user nova-compute[74701]:     </nova:instance>
Oct 20 13:35:39 user nova-compute[74701]:   </metadata>
Oct 20 13:35:39 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:35:39 user nova-compute[74701]:     <system>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="serial">776d8fb2-c6b3-4cb9-aa30-81e16c92d02c</entry>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="uuid">776d8fb2-c6b3-4cb9-aa30-81e16c92d02c</entry>
Oct 20 13:35:39 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:35:39 user nova-compute[74701]:     </system>
Oct 20 13:35:39 user nova-compute[74701]:   </sysinfo>
Oct 20 13:35:39 user nova-compute[74701]:   <os>
Oct 20 13:35:39 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:35:39 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:35:39 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:35:39 user nova-compute[74701]:   </os>
Oct 20 13:35:39 user nova-compute[74701]:   <features>
Oct 20 13:35:39 user nova-compute[74701]:     <acpi/>
Oct 20 13:35:39 user nova-compute[74701]:     <apic/>
Oct 20 13:35:39 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:35:39 user nova-compute[74701]:   </features>
Oct 20 13:35:39 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:35:39 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:35:39 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:35:39 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:35:39 user nova-compute[74701]:   </clock>
Oct 20 13:35:39 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:35:39 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:35:39 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:35:39 user nova-compute[74701]:   </cpu>
Oct 20 13:35:39 user nova-compute[74701]:   <devices>
Oct 20 13:35:39 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:35:39 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:35:39 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk"/>
Oct 20 13:35:39 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:35:39 user nova-compute[74701]:     </disk>
Oct 20 13:35:39 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:35:39 user nova-compute[74701]:       <mac address="fa:16:3e:8b:82:71"/>
Oct 20 13:35:39 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:35:39 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:35:39 user nova-compute[74701]:       <target dev="tap1d3a1639-4c"/>
Oct 20 13:35:39 user nova-compute[74701]:     </interface>
Oct 20 13:35:39 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:35:39 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/console.log" append="off"/>
Oct 20 13:35:39 user nova-compute[74701]:     </serial>
Oct 20 13:35:39 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:35:39 user nova-compute[74701]:     <video>
Oct 20 13:35:39 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:35:39 user nova-compute[74701]:     </video>
Oct 20 13:35:39 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:35:39 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:35:39 user nova-compute[74701]:     </rng>
Oct 20 13:35:39 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:35:39 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:35:39 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:35:39 user nova-compute[74701]:     </memballoon>
Oct 20 13:35:39 user nova-compute[74701]:   </devices>
Oct 20 13:35:39 user nova-compute[74701]: </domain>
Oct 20 13:35:39 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1084448285',display_name='tempest-AttachVolumeTestJSON-server-1084448285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1084448285',id=45,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyI1BsriDDt1gO2NndtrGdeeyd4bInjVunwtgazba+Y+FVCSm8Kbnjv7JbQBBKBFMhVN3dXStpjXauNk+9tpfEK0YM8RcPQXSXXcAiIPAKZRvUlEDUOS7QuU0Wi2r4zHA==',key_name='tempest-keypair-1540280801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-szo2tk4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=776d8fb2-c6b3-4cb9-aa30-81e16c92d02c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG os_vif [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1d55abd-0183-5b6a-8fbb-a0ab091e87bd', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d3a1639-4c, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d3a1639-4c, col_values=(('qos', UUID('32849e55-c32e-4c51-90a5-f9223f07fcfc')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d3a1639-4c, col_values=(('external_ids', {'iface-id': '1d3a1639-4ce1-4a35-ab22-a62887b641a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:82:71', 'vm-uuid': '776d8fb2-c6b3-4cb9-aa30-81e16c92d02c'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:39 user nova-compute[74701]: INFO os_vif [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c')
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:35:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No VIF found with MAC fa:16:3e:8b:82:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:35:40 user nova-compute[74701]: DEBUG nova.network.neutron [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updated VIF entry in instance network info cache for port 1d3a1639-4ce1-4a35-ab22-a62887b641a5. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:35:40 user nova-compute[74701]: DEBUG nova.network.neutron [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:35:40 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-36c20a3f-a771-4e65-9c8f-7ccb73a5429d req-f823e634-9707-4d6e-8810-c16bf149e9ae service nova] Releasing lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG nova.compute.manager [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] No waiting events found dispatching network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:41 user nova-compute[74701]: WARNING nova.compute.manager [req-8488bfe3-5ccc-4eb0-82cd-5806f2aa5dd2 req-d9c071f4-3dc0-4810-bc7b-cf7559101d60 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received unexpected event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 for instance with vm_state building and task_state spawning.
Oct 20 13:35:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:35:43 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Instance spawned successfully.
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:35:43 user nova-compute[74701]: INFO nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] No waiting events found dispatching network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:35:43 user nova-compute[74701]: WARNING nova.compute.manager [req-01711fc0-5793-4295-8dc8-7e3582222264 req-5777cdec-331d-41a0-a7f8-65d8d7fa78ea service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received unexpected event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 for instance with vm_state building and task_state spawning.
Oct 20 13:35:43 user nova-compute[74701]: INFO nova.compute.manager [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Took 6.06 seconds to build instance.
Oct 20 13:35:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-42a6f1b2-9d7d-4f12-b827-cdc90ca69c36 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.162s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:35:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:35:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:36:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:36:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:36:14 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:36:14 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=24.990589141845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2b24a52-b82a-47eb-9e47-4ca49c469fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:36:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [{"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:36:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:36:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:36:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:52 user nova-compute[74701]: INFO nova.compute.manager [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Terminating instance
Oct 20 13:36:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-unplugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] No waiting events found dispatching network-vif-unplugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:36:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-91d06b3f-2cb3-4631-bed3-06761b3cdf0e req-5aa8127b-e310-42a1-a899-861187c9f26a service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-unplugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:36:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Instance destroyed successfully.
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lazy-loading 'resources' on Instance uuid f6eae62d-6deb-4ed4-bc20-b1d6e59fca90 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1218930607',display_name='tempest-SnapshotDataIntegrityTests-server-1218930607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1218930607',id=41,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbOgqjx4wE5zdCA8D8SNYrvkIaHh0BO6F5lxURDU+9rTOWTbnsBPzVSpfLXMN+PSFixKjd8+y/RlQbrKuYQw6xROp2XrTkDFSqEVWceB5HBt/awA2UEk284GsqrcZLFwQ==',key_name='tempest-keypair-824515255',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70909b4823c741d3ba1a2b94d14a8b20',ramdisk_id='',reservation_id='r-mn9up78l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-224030944',owner_user_name='tempest-SnapshotDataIntegrityTests-224030944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c511a58dbf04969819db3f49cadf236',uuid=f6eae62d-6deb-4ed4-bc20-b1d6e59fca90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converting VIF {"id": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "address": "fa:16:3e:c1:78:65", "network": {"id": "6c7e9af9-27cd-489e-abd6-eb0da323f6c9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1159082926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70909b4823c741d3ba1a2b94d14a8b20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e70767-0b", "ovs_interfaceid": "90e70767-0b33-4938-a5b0-28b4bc5a94ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG os_vif [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e70767-0b, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e445520-4dde-457f-8e93-f66598ffc7ce) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:36:53 user nova-compute[74701]: INFO os_vif [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:78:65,bridge_name='br-int',has_traffic_filtering=True,id=90e70767-0b33-4938-a5b0-28b4bc5a94ff,network=Network(6c7e9af9-27cd-489e-abd6-eb0da323f6c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e70767-0b')
Oct 20 13:36:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Deleting instance files /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90_del
Oct 20 13:36:53 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Deletion of /opt/stack/data/nova/instances/f6eae62d-6deb-4ed4-bc20-b1d6e59fca90_del complete
Oct 20 13:36:53 user nova-compute[74701]: INFO nova.compute.manager [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 13:36:53 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:36:53 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:36:54 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Took 1.14 seconds to deallocate network for instance.
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:54 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Deleted allocations for instance f6eae62d-6deb-4ed4-bc20-b1d6e59fca90
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] Acquiring lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] No waiting events found dispatching network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:36:54 user nova-compute[74701]: WARNING nova.compute.manager [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received unexpected event network-vif-plugged-90e70767-0b33-4938-a5b0-28b4bc5a94ff for instance with vm_state deleted and task_state None.
Oct 20 13:36:54 user nova-compute[74701]: DEBUG nova.compute.manager [req-4cfea1c5-06fd-4445-912c-73247e870d9a req-ad97a86a-1dcb-4375-b484-51356fe62af8 service nova] [instance: f6eae62d-6deb-4ed4-bc20-b1d6e59fca90] Received event network-vif-deleted-90e70767-0b33-4938-a5b0-28b4bc5a94ff {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:36:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-27fcbe53-9c12-4320-869e-22a67fc513bf tempest-SnapshotDataIntegrityTests-224030944 tempest-SnapshotDataIntegrityTests-224030944-project-member] Lock "f6eae62d-6deb-4ed4-bc20-b1d6e59fca90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:36:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:00 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:37:00 user nova-compute[74701]: INFO nova.compute.claims [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Claim successful on node user
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:37:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:37:01 user nova-compute[74701]: INFO nova.virt.block_device [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Booting with volume 8459755a-4e70-466d-bc79-853e5259aa29 at /dev/vda
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.policy [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.utils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f34b6-3c33-4b24-aac1-a9db0b71b158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9957f7-3e0e-439c-8c93-c096ce58970c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2778c1ee-f34d-48bf-a569-c8abc2b54935]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d49ad-e296-4649-80ca-84d44665bd64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:37:01 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:37:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[315051ff-2524-4149-8690-3a3cea8cfa8f]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG os_brick.utils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating existing volume attachment record: f0396eb1-0cc8-474f-8f6f-03de7ceaf8f2 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:37:01 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Successfully created port: 2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Successfully updated port: 2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-changed-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Refreshing instance network info cache due to event network-changed-2e31e8ef-5e96-4ab3-a0d0-1de15af11607. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] Acquiring lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.network.neutron [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Instance network_info: |[{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] Acquired lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:02 user nova-compute[74701]: DEBUG nova.network.neutron [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Refreshing network info cache for port 2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updated VIF entry in instance network info cache for port 2e31e8ef-5e96-4ab3-a0d0-1de15af11607. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1d3f490f-7e42-4130-99a2-f28b35068602 req-9af30b88-3571-4bfe-8120-6e1fba41d77f service nova] Releasing lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing instance network info cache due to event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated VIF entry in instance network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b075b594-75bf-4f10-b729-9e1c98bf16c0 req-926f8e57-b08d-4b3c-a20c-aebcc5e3e5c7 service nova] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:04 user nova-compute[74701]: INFO nova.compute.manager [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Shelve offloading
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:37:04 user nova-compute[74701]: WARNING nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state active and task_state shelving.
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:37:04 user nova-compute[74701]: WARNING nova.compute.manager [req-24064d1c-bbe7-4474-a5ca-d89368454922 req-6c99cc4e-5aab-4180-9807-c5bb68953fcd service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state active and task_state shelving.
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance destroyed successfully.
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:04 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:37:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance destroyed successfully.
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'resources' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsq2RFUZmY7N4rDyg+VaerPnVzQAw6GID09vF4haNySWIqs830c3htSUZrpLOLrzLcX7dLzE3hoZddsP9lVm24nXOZZlBCv0oqwG3xZiuOSYal0TAYOyeVINHd484OsUA==',key_name='tempest-TestShelveInstance-581037021',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:35:34Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_vif [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82afa982-0b, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7b967c5-d6b3-4e66-8ca3-8d823492083a) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:37:06 user nova-compute[74701]: INFO os_vif [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b')
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:37:06 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fce8cf-e8f1-45cd-b0e4-67561d1ca3ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:37:06 user nova-compute[74701]: No targets found.
Oct 20 13:37:06 user nova-compute[74701]: iSNS:
Oct 20 13:37:06 user nova-compute[74701]: No targets found.
Oct 20 13:37:06 user nova-compute[74701]: STATIC:
Oct 20 13:37:06 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4
Oct 20 13:37:06 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:37:06 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:37:06 user nova-compute[74701]: FIRMWARE:
Oct 20 13:37:06 user nova-compute[74701]: No targets found.
Oct 20 13:37:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:37:06 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:37:06 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942496c-ca53-4c3c-b3ae-9747808a1d01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f76e07-abe7-455d-948f-45f799c9818c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:37:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:37:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc620700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c953e9-6eb3-4519-bad3-4b88303b6104]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf22ae5-0513-4547-a457-92244f0c18ee]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8aad9a-8545-424f-9eed-f83ce8f4af5d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[95100d9d-bbf2-4d4c-b633-47e06802905b]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e82d2ab-aaff-4075-b04e-91142126658a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69b534-2bdc-4214-89dd-dfa52d302114]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]
Oct 20 13:37:06 user nova-compute[74701]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.
Oct 20 13:37:06 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077066f-6eb9-47d5-82dd-ebe71696db8d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== disconnect_volume: return (278ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:37:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deleting instance files /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff_del
Oct 20 13:37:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deletion of /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff_del complete
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing instance network info cache due to event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:06 user nova-compute[74701]: DEBUG nova.network.neutron [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.network.neutron [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated VIF entry in instance network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.network.neutron [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": null, "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap82afa982-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-2f50e2fb-1495-4f7b-b6f6-6dd0279997a5 req-0f5ac959-ae73-4875-b2dd-d912c65046e5 service nova] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:07 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Deleted allocations for instance f2b24a52-b82a-47eb-9e47-4ca49c469fff
Oct 20 13:37:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'numa_topology' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.objects.base [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Object Instance<f2b24a52-b82a-47eb-9e47-4ca49c469fff> lazy-loaded attributes: resources,numa_topology {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:37:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b1e642cc-0319-41ab-b983-48089f275ef4 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.869s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:37:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:37:13 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.007854461669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2964fbe-707b-4c90-878b-10608b2842e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:37:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:16 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:37:17 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Creating image(s)
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Ensure instance console log exists: /opt/stack/data/nova/instances/f2964fbe-707b-4c90-878b-10608b2842e4/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Start _get_guest_xml network_info=[{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcjvrNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2964fbe-707b-4c90-878b-10608b2842e4', 'attached_at': '', 'detached_at': '', 'volume_id': '8459755a-4e70-466d-bc79-853e5259aa29', 'serial': '8459755a-4e70-466d-bc79-853e5259aa29'}, 'attachment_id': 'f0396eb1-0cc8-474f-8f6f-03de7ceaf8f2', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:37:17 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:37:17 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcjvrNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:37:17 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:37:17 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:37:17 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05143289-a2ee-4d64-8c8d-810301f64336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:37:17 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc59a1e-a7bf-44d4-89e2-71ae496b3270]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29] added
Oct 20 13:37:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05962af8-fbf2-42a7-b7ad-713bb264b513]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8083c44-8b41-4fb3-84b6-882ca3c6d1d6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygcjvrNz {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygcjvrNz" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c3d01-2365-4153-8dfa-4b0bb075e742]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygcjvrNz'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdc939-4c4e-4008-b07d-4a6e16f045ab]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[148eba00-59d7-41e8-808c-14abf186b32b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:37:17 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:37:17 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:37:17 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:37:17 user nova-compute[74701]: 
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[89988aff-b17b-4df4-b980-dc973f0f9f1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260]
Oct 20 13:37:17 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260] successful.
Oct 20 13:37:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5c026-cde0-4707-a641-758310d99549]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd2a7be-cbec-4687-a3a5-ebb186d92997]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a4f5fe-de72-4748-8dde-b2aad554796d]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcjvrNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:17 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26534386636313538', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534386636313538', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-962269315',display_name='tempest-TestVolumeBootPattern-volume-backed-server-962269315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-962269315',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLVpG3M/UGAmYYW8HwEol0ZFttSXD9+z8CYdp9JnD+ThQ3HZKqknlMs9sQfyEyZGw+qUBFuTxg2AcF7WbIEHD4UlE6A7Invr3oU63SRUIFNo55YAy853UL+NIVo6HJXHA==',key_name='tempest-keypair-552943348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-8pnwbrt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=f2964fbe-707b-4c90-878b-10608b2842e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid f2964fbe-707b-4c90-878b-10608b2842e4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:37:18 user nova-compute[74701]:   <uuid>f2964fbe-707b-4c90-878b-10608b2842e4</uuid>
Oct 20 13:37:18 user nova-compute[74701]:   <name>instance-0000002e</name>
Oct 20 13:37:18 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:37:18 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:37:18 user nova-compute[74701]:   <metadata>
Oct 20 13:37:18 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:37:18 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:37:18 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-962269315</nova:name>
Oct 20 13:37:18 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:37:17</nova:creationTime>
Oct 20 13:37:18 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:37:18 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:37:18 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:37:18 user nova-compute[74701]:       <nova:owner>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:37:18 user nova-compute[74701]:       </nova:owner>
Oct 20 13:37:18 user nova-compute[74701]:       <nova:ports>
Oct 20 13:37:18 user nova-compute[74701]:         <nova:port uuid="2e31e8ef-5e96-4ab3-a0d0-1de15af11607">
Oct 20 13:37:18 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:37:18 user nova-compute[74701]:         </nova:port>
Oct 20 13:37:18 user nova-compute[74701]:       </nova:ports>
Oct 20 13:37:18 user nova-compute[74701]:     </nova:instance>
Oct 20 13:37:18 user nova-compute[74701]:   </metadata>
Oct 20 13:37:18 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:37:18 user nova-compute[74701]:     <system>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="serial">f2964fbe-707b-4c90-878b-10608b2842e4</entry>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="uuid">f2964fbe-707b-4c90-878b-10608b2842e4</entry>
Oct 20 13:37:18 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:37:18 user nova-compute[74701]:     </system>
Oct 20 13:37:18 user nova-compute[74701]:   </sysinfo>
Oct 20 13:37:18 user nova-compute[74701]:   <os>
Oct 20 13:37:18 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:37:18 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:37:18 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:37:18 user nova-compute[74701]:   </os>
Oct 20 13:37:18 user nova-compute[74701]:   <features>
Oct 20 13:37:18 user nova-compute[74701]:     <acpi/>
Oct 20 13:37:18 user nova-compute[74701]:     <apic/>
Oct 20 13:37:18 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:37:18 user nova-compute[74701]:   </features>
Oct 20 13:37:18 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:37:18 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:37:18 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:37:18 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:37:18 user nova-compute[74701]:   </clock>
Oct 20 13:37:18 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:37:18 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:37:18 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:37:18 user nova-compute[74701]:   </cpu>
Oct 20 13:37:18 user nova-compute[74701]:   <devices>
Oct 20 13:37:18 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:37:18 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:37:18 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:37:18 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:37:18 user nova-compute[74701]:       <serial>8459755a-4e70-466d-bc79-853e5259aa29</serial>
Oct 20 13:37:18 user nova-compute[74701]:     </disk>
Oct 20 13:37:18 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:37:18 user nova-compute[74701]:       <mac address="fa:16:3e:ea:1e:08"/>
Oct 20 13:37:18 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:37:18 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:37:18 user nova-compute[74701]:       <target dev="tap2e31e8ef-5e"/>
Oct 20 13:37:18 user nova-compute[74701]:     </interface>
Oct 20 13:37:18 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:37:18 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f2964fbe-707b-4c90-878b-10608b2842e4/console.log" append="off"/>
Oct 20 13:37:18 user nova-compute[74701]:     </serial>
Oct 20 13:37:18 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:37:18 user nova-compute[74701]:     <video>
Oct 20 13:37:18 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:37:18 user nova-compute[74701]:     </video>
Oct 20 13:37:18 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:37:18 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:37:18 user nova-compute[74701]:     </rng>
Oct 20 13:37:18 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:37:18 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:37:18 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:37:18 user nova-compute[74701]:     </memballoon>
Oct 20 13:37:18 user nova-compute[74701]:   </devices>
Oct 20 13:37:18 user nova-compute[74701]: </domain>
Oct 20 13:37:18 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-962269315',display_name='tempest-TestVolumeBootPattern-volume-backed-server-962269315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-962269315',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLVpG3M/UGAmYYW8HwEol0ZFttSXD9+z8CYdp9JnD+ThQ3HZKqknlMs9sQfyEyZGw+qUBFuTxg2AcF7WbIEHD4UlE6A7Invr3oU63SRUIFNo55YAy853UL+NIVo6HJXHA==',key_name='tempest-keypair-552943348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-8pnwbrt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=f2964fbe-707b-4c90-878b-10608b2842e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG os_vif [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c6e0909-23b5-58d4-ad6e-0ac4ae134fd7', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e31e8ef-5e, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e31e8ef-5e, col_values=(('qos', UUID('cb0b0116-1c95-4399-b1a2-7ad3d67eb964')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e31e8ef-5e, col_values=(('external_ids', {'iface-id': '2e31e8ef-5e96-4ab3-a0d0-1de15af11607', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:1e:08', 'vm-uuid': 'f2964fbe-707b-4c90-878b-10608b2842e4'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:18 user nova-compute[74701]: INFO os_vif [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e')
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:37:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:ea:1e:08, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:37:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:37:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] No waiting events found dispatching network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:37:20 user nova-compute[74701]: WARNING nova.compute.manager [req-5e96dbac-aa5c-400b-b03b-75826374b705 req-fe625d5e-6b33-41d6-b9c9-b05a47a8658b service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received unexpected event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 for instance with vm_state building and task_state spawning.
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:20 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:37:22 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Instance spawned successfully.
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:37:22 user nova-compute[74701]: INFO nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Took 4.94 seconds to spawn the instance on the hypervisor.
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:22 user nova-compute[74701]: DEBUG nova.compute.manager [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] No waiting events found dispatching network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:37:22 user nova-compute[74701]: WARNING nova.compute.manager [req-1b9b8cac-a269-465a-85cc-2d1b242049e8 req-5edbff17-9848-4ae5-99ed-0a003d286dcc service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received unexpected event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 for instance with vm_state building and task_state spawning.
Oct 20 13:37:22 user nova-compute[74701]: INFO nova.compute.manager [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Took 21.63 seconds to build instance.
Oct 20 13:37:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-3995de4f-6f08-434b-9a8c-aa0b3c77624d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.726s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:37:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:37:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-changed-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Refreshing instance network info cache due to event network-changed-1d3a1639-4ce1-4a35-ab22-a62887b641a5. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] Acquiring lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] Acquired lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG nova.network.neutron [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Refreshing network info cache for port 1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:37:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updated VIF entry in instance network info cache for port 1d3a1639-4ce1-4a35-ab22-a62887b641a5. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:37:29 user nova-compute[74701]: DEBUG nova.network.neutron [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:37:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-16f15b35-0106-4859-8d02-32c3890fbdc4 req-53bc0bff-6782-4502-b5a5-e8f89cc0b9ba service nova] Releasing lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:37:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:34 user nova-compute[74701]: DEBUG nova.objects.instance [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:37:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:37:35 user nova-compute[74701]: INFO nova.compute.manager [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attaching volume 44b6d876-1ae9-4e43-a4af-47a6ecc367f3 to /dev/vdb
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e7e38-cabe-4d47-9569-c94cd135fa96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e9848-76d5-474d-9a7c-7fc2e2a92aee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1f123-57aa-4ac2-9c85-dc0fedba9fd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7e76a-71a7-4615-af2d-8ac1ef203844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:37:35 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ca43e-54a0-4d14-a8c1-e085510ed588]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG os_brick.utils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating existing volume attachment record: 272009ea-ec32-4523-8c31-e1c870782e6c {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:37:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:37:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFuybBUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:37:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:37:51 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:37:51 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb7d34-9ee3-4760-b90a-1104f40cda41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:37:51 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d73c5-86c2-424a-8e28-9f2a4434d7fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3] added
Oct 20 13:37:51 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8414c-fd02-49fe-849a-51093aff32ea]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd81a52-81ae-4164-973a-05c7c460c1f1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFuybBUe {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFuybBUe" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f8377-09fc-4aee-aaf0-5dcca4a95cc6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFuybBUe'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:51 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c50022b-76ba-49be-82f5-9db82861c9d0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8671596-2505-4ac3-908f-54de4d8a30f0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[934929bb-2058-45eb-8275-656a09e41d87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260]
Oct 20 13:37:52 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260] successful.
Oct 20 13:37:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff77e6-0317-4d6f-8fa8-82c56ab4c705]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998cd64-ac40-47a9-97ab-bc780a61641e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:37:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c9d0be-92d3-4946-9efa-c12b8ffa6ed0]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFuybBUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:37:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23465316665623262', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465316665623262', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.objects.instance [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:37:53 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:37:53 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:37:53 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:37:53 user nova-compute[74701]:   <serial>44b6d876-1ae9-4e43-a4af-47a6ecc367f3</serial>
Oct 20 13:37:53 user nova-compute[74701]: </disk>
Oct 20 13:37:53 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No VIF found with MAC fa:16:3e:8b:82:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00cdff1c-bbca-435c-843c-b8952f04f2e2 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.653s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:37:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:37:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:00 user nova-compute[74701]: INFO nova.compute.manager [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attaching volume a2df48ff-ed60-462a-bf3d-72934bb22ccd to /dev/vdc
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.utils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a7b5ed-3c15-44b7-8f53-95798b8b010e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6de53-7999-46c0-80df-676520569cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed762e67-ce74-4720-a001-c4703fa73cb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9415ff4f-ced2-4456-b81a-b866a87c288c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:38:00 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:38:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3360c7b8-f785-4caf-beec-fcbadae7bf7a]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG os_brick.utils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:38:00 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating existing volume attachment record: 71ca09ae-8f97-4a49-8dca-0a86941c8b6f {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:38:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:38:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:38:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:38:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:38:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:38:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.00478744506836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2964fbe-707b-4c90-878b-10608b2842e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsVvntqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:38:16 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:38:16 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:38:16 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eae7f3-1dd6-4707-8669-4920b0e1f98a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:38:16 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c56094-915a-4b93-a52c-9a9e5e5602bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd] added
Oct 20 13:38:16 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd87b30-a348-4534-ba94-8165670893f7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e271baf8-6909-4374-9a5b-82b38f08ea76]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsVvntqg {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsVvntqg" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[324eae93-d1a0-4453-a8cd-3beff4f849c0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xsVvntqg'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:16 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e1cc9-0d2f-481a-b00f-b78f170af3ce]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[84689379-d617-4457-89d9-f5f641318c16]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd1c8f5-1316-41dd-8f1b-f407edf0940c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260]
Oct 20 13:38:17 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260] successful.
Oct 20 13:38:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[46714b4f-ae51-4037-a9eb-3216a7eb2733]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c798d8-529e-4b8f-911e-f0c903d79a78]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:38:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:17 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:38:17 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbfb4f6-e466-4514-8a5b-e1d6913363e9]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:17 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsVvntqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26135333438333233', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135333438333233', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.objects.instance [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:38:18 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:38:18 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:38:18 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:38:18 user nova-compute[74701]:   <serial>a2df48ff-ed60-462a-bf3d-72934bb22ccd</serial>
Oct 20 13:38:18 user nova-compute[74701]: </disk>
Oct 20 13:38:18 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] No VIF found with MAC fa:16:3e:8b:82:71, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-103e47d8-9695-4b6b-9a17-6bfe276d2f95 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:38:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [{"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:20 user nova-compute[74701]: INFO nova.compute.manager [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Detaching volume 44b6d876-1ae9-4e43-a4af-47a6ecc367f3
Oct 20 13:38:20 user nova-compute[74701]: INFO nova.virt.block_device [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attempting to driver detach volume 44b6d876-1ae9-4e43-a4af-47a6ecc367f3 from mountpoint /dev/vdb
Oct 20 13:38:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Attempting to detach device vdb from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:38:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:38:20 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:38:20 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:38:20 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:38:20 user nova-compute[74701]:   <serial>44b6d876-1ae9-4e43-a4af-47a6ecc367f3</serial>
Oct 20 13:38:20 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:38:20 user nova-compute[74701]: </disk>
Oct 20 13:38:20 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:38:20 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdb from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the persistent domain config.
Oct 20 13:38:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:38:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:38:20 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:38:20 user nova-compute[74701]:   <source dev="/dev/sdc"/>
Oct 20 13:38:20 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:38:20 user nova-compute[74701]:   <serial>44b6d876-1ae9-4e43-a4af-47a6ecc367f3</serial>
Oct 20 13:38:20 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:38:20 user nova-compute[74701]: </disk>
Oct 20 13:38:20 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:38:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:38:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:38:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:37 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:38:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:40 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c is timed out.
Oct 20 13:38:40 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdb from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the live domain config.
Oct 20 13:38:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFuybBUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:38:40 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db53a89-131d-4342-b0ac-63c6ef7068f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:38:40 user nova-compute[74701]: No targets found.
Oct 20 13:38:40 user nova-compute[74701]: iSNS:
Oct 20 13:38:40 user nova-compute[74701]: No targets found.
Oct 20 13:38:40 user nova-compute[74701]: STATIC:
Oct 20 13:38:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29
Oct 20 13:38:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:38:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:38:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd
Oct 20 13:38:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:38:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:38:40 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3
Oct 20 13:38:40 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:38:40 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:38:40 user nova-compute[74701]: FIRMWARE:
Oct 20 13:38:40 user nova-compute[74701]: No targets found.
Oct 20 13:38:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:38:40 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:38:40 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[126c0589-f181-412e-beb9-7ce51b50629e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69082040-3014-45bb-9863-544d79de064d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:40 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:40 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:38:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:38:40 user nova-compute[74701]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 (non-flash)
Oct 20 13:38:40 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:38:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e07cc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f6650-2357-4e02-8ede-b54a454bda9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab01554-c628-4402-a132-957413bf3582]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f84dee-39ea-49d9-b8db-874286643554]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b1971-38a2-441a-a654-b9eb15caa50f]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c7fc31-d22d-4606-8578-e8ee91672b9d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a120b55f-0c83-4810-9efd-18ba8da654a8]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260]
Oct 20 13:38:40 user nova-compute[74701]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3, portal: 172.16.0.220,3260] successful.
Oct 20 13:38:40 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b6d876-1ae9-4e43-a4af-47a6ecc367f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[32abd592-fda3-42e0-b96c-72c91ab9a6f0]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== disconnect_volume: return (286ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:38:40 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:38:41 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:38:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4e60d05a-cd55-4deb-a274-069d2fa08e74 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.857s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:38:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:42 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:42 user nova-compute[74701]: INFO nova.compute.manager [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Detaching volume a2df48ff-ed60-462a-bf3d-72934bb22ccd
Oct 20 13:38:42 user nova-compute[74701]: INFO nova.virt.block_device [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Attempting to driver detach volume a2df48ff-ed60-462a-bf3d-72934bb22ccd from mountpoint /dev/vdc
Oct 20 13:38:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Attempting to detach device vdc from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:38:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:38:42 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:38:42 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:38:42 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:38:42 user nova-compute[74701]:   <serial>a2df48ff-ed60-462a-bf3d-72934bb22ccd</serial>
Oct 20 13:38:42 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:38:42 user nova-compute[74701]: </disk>
Oct 20 13:38:42 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:38:42 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdc from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the persistent domain config.
Oct 20 13:38:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:38:42 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:38:42 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:38:42 user nova-compute[74701]:   <source dev="/dev/sdd"/>
Oct 20 13:38:42 user nova-compute[74701]:   <target dev="vdc" bus="virtio"/>
Oct 20 13:38:42 user nova-compute[74701]:   <serial>a2df48ff-ed60-462a-bf3d-72934bb22ccd</serial>
Oct 20 13:38:42 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 13:38:42 user nova-compute[74701]: </disk>
Oct 20 13:38:42 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:38:43 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:38:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:38:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-changed-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:38:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Refreshing instance network info cache due to event network-changed-2e31e8ef-5e96-4ab3-a0d0-1de15af11607. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:38:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] Acquiring lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:38:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] Acquired lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:38:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Refreshing network info cache for port 2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:38:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updated VIF entry in instance network info cache for port 2e31e8ef-5e96-4ab3-a0d0-1de15af11607. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:38:52 user nova-compute[74701]: DEBUG nova.network.neutron [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:38:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-eae79986-e257-47c9-b5cd-53bd59c1cc54 req-988805f1-d8db-4f0d-9a45-234225b475ca service nova] Releasing lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:38:53 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:38:56 user nova-compute[74701]: INFO nova.compute.manager [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Unshelving
Oct 20 13:38:56 user nova-compute[74701]: INFO nova.virt.block_device [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Booting with volume e8577724-c6ee-4b66-a2c5-6e9553023fe4 at /dev/vda
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.utils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d9ae6-bf47-4490-9877-8b74d9f5ed41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b30264-75bd-4587-9b5a-fb6b89a41a9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc75b41f-0b66-4652-aae1-a7fb25eebff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970384a-781a-40ac-a0c9-e02480cb9719]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:38:56 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:38:56 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee61ac-9151-4872-8d05-1f0ef849e853]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG os_brick.utils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:38:56 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating existing volume attachment record: 85b45472-742a-47f6-a8f9-bf1dd6d9c8e7 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:38:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:38:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:03 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c is timed out.
Oct 20 13:39:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully detached device vdc from instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c from the live domain config.
Oct 20 13:39:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsVvntqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:39:03 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[37731236-dde4-466d-8bd8-569e345dd192]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:39:03 user nova-compute[74701]: No targets found.
Oct 20 13:39:03 user nova-compute[74701]: iSNS:
Oct 20 13:39:03 user nova-compute[74701]: No targets found.
Oct 20 13:39:03 user nova-compute[74701]: STATIC:
Oct 20 13:39:03 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29
Oct 20 13:39:03 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:39:03 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:39:03 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd
Oct 20 13:39:03 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:39:03 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:39:03 user nova-compute[74701]: FIRMWARE:
Oct 20 13:39:03 user nova-compute[74701]: No targets found.
Oct 20 13:39:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:39:03 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:39:03 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae1c4d4-4a97-4685-8dbb-19df7429c39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1beec04-1ffe-4048-9d53-d6167d0b9d55]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:03 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:39:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:03 user nova-compute[74701]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd (non-flash)
Oct 20 13:39:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86f82cf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[644470eb-2906-4dee-8531-b6ed01238043]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02162846-ff91-490b-9b30-5ee9b2379ddb]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a14dd4-5a16-4ea4-881d-10c95184dc72]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df6fe5-7030-4b34-b123-9e027c98fcec]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff54cc99-f01d-4e20-bc27-f3a134e7b903]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[16152d60-18d5-4918-9a6a-fd2e4b2b84c4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260]
Oct 20 13:39:03 user nova-compute[74701]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd, portal: 172.16.0.220,3260] successful.
Oct 20 13:39:03 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2df48ff-ed60-462a-bf3d-72934bb22ccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[409dba9f-d19c-4cf3-87b1-63987cdca4d3]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] <== disconnect_volume: return (291ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:39:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG nova.objects.instance [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'flavor' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-1b9f04c8-c275-4fe5-bf0d-5816bc830d17 tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:04 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:39:04 user nova-compute[74701]: INFO nova.compute.claims [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Claim successful on node user
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:39:05 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:39:05 user nova-compute[74701]: INFO nova.virt.block_device [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Booting with volume snapshot 3404fed9-bb48-4197-9b49-5db354573652 at /dev/vda
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.policy [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:05 user nova-compute[74701]: INFO nova.compute.manager [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Terminating instance
Oct 20 13:39:05 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-unplugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] No waiting events found dispatching network-vif-unplugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.compute.manager [req-84e5d521-70e3-4478-9c43-ac562b8e09ef req-13cee597-e6fd-4785-853e-4183fc76cb6e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-unplugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Successfully created port: 75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:39:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Instance destroyed successfully.
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lazy-loading 'resources' on Instance uuid 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1084448285',display_name='tempest-AttachVolumeTestJSON-server-1084448285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1084448285',id=45,image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyI1BsriDDt1gO2NndtrGdeeyd4bInjVunwtgazba+Y+FVCSm8Kbnjv7JbQBBKBFMhVN3dXStpjXauNk+9tpfEK0YM8RcPQXSXXcAiIPAKZRvUlEDUOS7QuU0Wi2r4zHA==',key_name='tempest-keypair-1540280801',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2eef02ee91884642a3c6612d54890923',ramdisk_id='',reservation_id='r-szo2tk4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5624a009-5482-4bf8-9162-de2cb54fd34f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-117323651',owner_user_name='tempest-AttachVolumeTestJSON-117323651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='037a86ef21bf4b58874c1ce851f51ae6',uuid=776d8fb2-c6b3-4cb9-aa30-81e16c92d02c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converting VIF {"id": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "address": "fa:16:3e:8b:82:71", "network": {"id": "54f6feb0-9812-44f0-b651-d78e41795675", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596523886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eef02ee91884642a3c6612d54890923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3a1639-4c", "ovs_interfaceid": "1d3a1639-4ce1-4a35-ab22-a62887b641a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG os_vif [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d3a1639-4c, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32849e55-c32e-4c51-90a5-f9223f07fcfc) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:06 user nova-compute[74701]: INFO os_vif [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:82:71,bridge_name='br-int',has_traffic_filtering=True,id=1d3a1639-4ce1-4a35-ab22-a62887b641a5,network=Network(54f6feb0-9812-44f0-b651-d78e41795675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3a1639-4c')
Oct 20 13:39:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Deleting instance files /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c_del
Oct 20 13:39:06 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Deletion of /opt/stack/data/nova/instances/776d8fb2-c6b3-4cb9-aa30-81e16c92d02c_del complete
Oct 20 13:39:06 user nova-compute[74701]: INFO nova.compute.manager [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 13:39:06 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:39:06 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Successfully updated port: 75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:39:07 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Took 0.77 seconds to deallocate network for instance.
Oct 20 13:39:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-70c6a7be-cc85-4a10-b5f5-b8a526d03ffd req-6c582130-9d5e-450f-85fb-2bd0fc38776e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-deleted-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:07 user nova-compute[74701]: INFO nova.compute.manager [req-70c6a7be-cc85-4a10-b5f5-b8a526d03ffd req-6c582130-9d5e-450f-85fb-2bd0fc38776e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Neutron deleted interface 1d3a1639-4ce1-4a35-ab22-a62887b641a5; detaching it from the instance and deleting it from the info cache
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [req-70c6a7be-cc85-4a10-b5f5-b8a526d03ffd req-6c582130-9d5e-450f-85fb-2bd0fc38776e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.compute.manager [req-70c6a7be-cc85-4a10-b5f5-b8a526d03ffd req-6c582130-9d5e-450f-85fb-2bd0fc38776e service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Detach interface failed, port_id=1d3a1639-4ce1-4a35-ab22-a62887b641a5, reason: Instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.network.neutron [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating instance_info_cache with network_info: [{"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:07 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Deleted allocations for instance 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Instance network_info: |[{"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:39:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4ac1359e-6a55-481a-b303-4461aa4a442d tempest-AttachVolumeTestJSON-117323651 tempest-AttachVolumeTestJSON-117323651-project-member] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Acquiring lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Lock "776d8fb2-c6b3-4cb9-aa30-81e16c92d02c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] No waiting events found dispatching network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:08 user nova-compute[74701]: WARNING nova.compute.manager [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: 776d8fb2-c6b3-4cb9-aa30-81e16c92d02c] Received unexpected event network-vif-plugged-1d3a1639-4ce1-4a35-ab22-a62887b641a5 for instance with vm_state deleted and task_state None.
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-changed-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.compute.manager [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Refreshing instance network info cache due to event network-changed-75c9ea23-5e93-45a9-9731-6dc0196e7070. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Acquiring lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Acquired lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Refreshing network info cache for port 75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updated VIF entry in instance network info cache for port 75c9ea23-5e93-45a9-9731-6dc0196e7070. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG nova.network.neutron [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating instance_info_cache with network_info: [{"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-571805a0-5dd0-4a5c-847c-5668b0119473 req-2b856874-215f-43b9-838a-f86a0e849a37 service nova] Releasing lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.utils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3abd4-30d4-4d1a-9a2f-18ffb568a0a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d4316-e93b-462c-9fe1-05b606ac1c61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c761e-effa-4a4a-a128-ec8aceccc2a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[236580a4-dfe7-4647-b9c1-026b63cf001e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:39:11 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:39:11 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5627aa3-85a2-4b81-b7f6-cb22ca3843ad]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG os_brick.utils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating existing volume attachment record: 267f9853-471a-440f-923e-a264057365ca {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:39:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG nova.objects.instance [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'pci_requests' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG nova.objects.instance [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'numa_topology' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:39:13 user nova-compute[74701]: INFO nova.compute.claims [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Claim successful on node user
Oct 20 13:39:13 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:39:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:13 user nova-compute[74701]: INFO nova.network.neutron [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating port 82afa982-0b78-4dd5-ba34-883b7de5204f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.compute.manager [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing instance network info cache due to event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.network.neutron [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:39:14 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Creating image(s)
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start _get_guest_xml network_info=[{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2b24a52-b82a-47eb-9e47-4ca49c469fff', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'serial': 'e8577724-c6ee-4b66-a2c5-6e9553023fe4'}, 'attachment_id': '85b45472-742a-47f6-a8f9-bf1dd6d9c8e7', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.network.neutron [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:39:14 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:14 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.objects.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Object Instance<f2b24a52-b82a-47eb-9e47-4ca49c469fff> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:39:14 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:39:14 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:39:14 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129fd88-6a2a-4e6a-8272-16e18d5a02ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:39:14 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[198c75b3-a2ac-4e31-81c0-e98f7dba02ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4] added
Oct 20 13:39:14 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcfe31b-523a-45e2-9344-35368005053c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69faa765-d411-46e1-92dc-9259b1680ed2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGytrsjS {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGytrsjS" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd9140-624e-4288-86cb-dba347480a64]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:14 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGytrsjS'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728aaaa-0fe8-415e-8a12-731d17129e0c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.030426025390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6779c-0951-4058-a6bc-e339722417e4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8840be6c-013b-401a-815d-4f0d9c7dbc82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]
Oct 20 13:39:15 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.
Oct 20 13:39:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2964fbe-707b-4c90-878b-10608b2842e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (40b83711-652c-474c-aa9f-09e010a7f984): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b23fe2b9-0d92-4775-a2f0-baacac4db248 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6646df7d-c3e2-4ef7-9d32-7f39c2c84271]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440c29b-1c3a-4443-9ca1-97991846efa4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.573s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e04c21-0d22-4eed-8e7b-fef67f8420a4]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated VIF entry in instance network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.network.neutron [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d5cc5b50-9b43-467f-a0f2-4c5707235388 req-6130da4d-c3c4-41ab-8df7-a12e0529de5d service nova] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:39:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.612s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== connect_volume: return (1614ms) {'type': 'block', 'scsi_wwn': '26336326531313365', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336326531313365', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-581037021',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:38:56Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.objects.instance [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.objects.base [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Object Instance<f2b24a52-b82a-47eb-9e47-4ca49c469fff> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:39:16 user nova-compute[74701]:   <uuid>f2b24a52-b82a-47eb-9e47-4ca49c469fff</uuid>
Oct 20 13:39:16 user nova-compute[74701]:   <name>instance-0000002c</name>
Oct 20 13:39:16 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:39:16 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:39:16 user nova-compute[74701]:   <metadata>
Oct 20 13:39:16 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:39:16 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:39:16 user nova-compute[74701]:       <nova:name>tempest-TestShelveInstance-server-1770888340</nova:name>
Oct 20 13:39:16 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:39:14</nova:creationTime>
Oct 20 13:39:16 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:39:16 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:39:16 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:39:16 user nova-compute[74701]:       <nova:owner>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:user uuid="34ba26330a2c4ca19f416307b591573d">tempest-TestShelveInstance-2036929292-project-member</nova:user>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:project uuid="c00ddc21f84c429e95e17cd7018c2165">tempest-TestShelveInstance-2036929292</nova:project>
Oct 20 13:39:16 user nova-compute[74701]:       </nova:owner>
Oct 20 13:39:16 user nova-compute[74701]:       <nova:ports>
Oct 20 13:39:16 user nova-compute[74701]:         <nova:port uuid="82afa982-0b78-4dd5-ba34-883b7de5204f">
Oct 20 13:39:16 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 13:39:16 user nova-compute[74701]:         </nova:port>
Oct 20 13:39:16 user nova-compute[74701]:       </nova:ports>
Oct 20 13:39:16 user nova-compute[74701]:     </nova:instance>
Oct 20 13:39:16 user nova-compute[74701]:   </metadata>
Oct 20 13:39:16 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:39:16 user nova-compute[74701]:     <system>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="serial">f2b24a52-b82a-47eb-9e47-4ca49c469fff</entry>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="uuid">f2b24a52-b82a-47eb-9e47-4ca49c469fff</entry>
Oct 20 13:39:16 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:39:16 user nova-compute[74701]:     </system>
Oct 20 13:39:16 user nova-compute[74701]:   </sysinfo>
Oct 20 13:39:16 user nova-compute[74701]:   <os>
Oct 20 13:39:16 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:39:16 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:39:16 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:39:16 user nova-compute[74701]:   </os>
Oct 20 13:39:16 user nova-compute[74701]:   <features>
Oct 20 13:39:16 user nova-compute[74701]:     <acpi/>
Oct 20 13:39:16 user nova-compute[74701]:     <apic/>
Oct 20 13:39:16 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:39:16 user nova-compute[74701]:   </features>
Oct 20 13:39:16 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:39:16 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:39:16 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:39:16 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:39:16 user nova-compute[74701]:   </clock>
Oct 20 13:39:16 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:39:16 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:39:16 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:39:16 user nova-compute[74701]:   </cpu>
Oct 20 13:39:16 user nova-compute[74701]:   <devices>
Oct 20 13:39:16 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:39:16 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:39:16 user nova-compute[74701]:       <source dev="/dev/sdc"/>
Oct 20 13:39:16 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:39:16 user nova-compute[74701]:       <serial>e8577724-c6ee-4b66-a2c5-6e9553023fe4</serial>
Oct 20 13:39:16 user nova-compute[74701]:     </disk>
Oct 20 13:39:16 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:39:16 user nova-compute[74701]:       <mac address="fa:16:3e:2f:c9:af"/>
Oct 20 13:39:16 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:39:16 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:39:16 user nova-compute[74701]:       <target dev="tap82afa982-0b"/>
Oct 20 13:39:16 user nova-compute[74701]:     </interface>
Oct 20 13:39:16 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:39:16 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff/console.log" append="off"/>
Oct 20 13:39:16 user nova-compute[74701]:     </serial>
Oct 20 13:39:16 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:39:16 user nova-compute[74701]:     <video>
Oct 20 13:39:16 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:39:16 user nova-compute[74701]:     </video>
Oct 20 13:39:16 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:39:16 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:39:16 user nova-compute[74701]:     </rng>
Oct 20 13:39:16 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:39:16 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:39:16 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:39:16 user nova-compute[74701]:     </memballoon>
Oct 20 13:39:16 user nova-compute[74701]:   </devices>
Oct 20 13:39:16 user nova-compute[74701]: </domain>
Oct 20 13:39:16 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-581037021',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:38:56Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG os_vif [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac9d8e15-cb35-57e0-bfe8-7e9ba0e521c6', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82afa982-0b, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82afa982-0b, col_values=(('qos', UUID('5892f0b4-562b-45b3-9737-72cda634bffd')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82afa982-0b, col_values=(('external_ids', {'iface-id': '82afa982-0b78-4dd5-ba34-883b7de5204f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:c9:af', 'vm-uuid': 'f2b24a52-b82a-47eb-9e47-4ca49c469fff'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:16 user nova-compute[74701]: INFO os_vif [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b')
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:39:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] No VIF found with MAC fa:16:3e:2f:c9:af, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:17 user nova-compute[74701]: DEBUG nova.compute.manager [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:17 user nova-compute[74701]: WARNING nova.compute.manager [req-14991db2-7c13-4509-ac49-0efcbe3e066f req-a28893ee-dd00-4b9c-8809-2326344bb89d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 13:39:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:39:19 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:39:19 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance spawned successfully.
Oct 20 13:39:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-374a7040-53d6-4c07-9e53-2982a6d8ddec tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.732s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:20 user nova-compute[74701]: WARNING nova.compute.manager [req-d3e0d3ab-d350-4c51-8b7a-4ade8ee7a3e8 req-e0b5c193-01bc-4208-bd3d-4cec88d6048a service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state active and task_state None.
Oct 20 13:39:20 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:20 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:25 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:39:28 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Creating image(s)
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Ensure instance console log exists: /opt/stack/data/nova/instances/b23fe2b9-0d92-4775-a2f0-baacac4db248/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Start _get_guest_xml network_info=[{"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T13:38:53Z,direct_url=<?>,disk_format='qcow2',id=76a6c985-f466-4dc1-a163-05894aef26e4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-953949858',owner='a8a3f132369e4dd4a0eb84377e1d158e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T13:38:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbkGUZdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b23fe2b9-0d92-4775-a2f0-baacac4db248', 'attached_at': '', 'detached_at': '', 'volume_id': 'e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 'serial': 'e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c'}, 'attachment_id': '267f9853-471a-440f-923e-a264057365ca', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:39:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T13:38:53Z,direct_url=<?>,disk_format='qcow2',id=76a6c985-f466-4dc1-a163-05894aef26e4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-953949858',owner='a8a3f132369e4dd4a0eb84377e1d158e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T13:38:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbkGUZdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:39:28 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:39:28 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:39:28 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf8316-20e2-4b52-913e-3942f5c51755]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:39:28 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acdcb52-03c9-432c-a49c-c9007ef9d745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c] added
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969aab8-95ef-4713-a6bd-a30b1d31952b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[493ce433-54ec-4b67-9f8f-65cb268bd8be]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbkGUZdN {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbkGUZdN" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670e8bb-036b-4f48-8f0f-8d88cf816590]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CbkGUZdN'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec124e-5eef-4ff4-9c9e-2aba44ec531e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[79314f87-fe4e-4009-b18b-8d114551e33b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab653aa1-48e0-4646-91bd-84eb48a57624]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260]
Oct 20 13:39:28 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260] successful.
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880f109-c94f-4f32-abe1-8ea2d5724605]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101f15b-5605-45c7-8641-5599d31c8b97]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:39:28 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:39:28 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2771ec-f248-4c77-af7e-a4c634135c75]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbkGUZdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26630666539323639', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630666539323639', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-65747615',id=47,image_ref='76a6c985-f466-4dc1-a163-05894aef26e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM51wmdF1mSNxkY5ezscBpRH3E1gnCZUG3ArR+o3rAKducHE/vX/tzISl33+QUIDAw/n0D1ftrQvXqiPRompg12WvCMnSjDNvJe3eKfF4cjtdoH1Ukwog+OvZf5A5NKWJA==',key_name='tempest-keypair-753374367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-borrrrtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725340178',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=b23fe2b9-0d92-4775-a2f0-baacac4db248,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid b23fe2b9-0d92-4775-a2f0-baacac4db248 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:39:29 user nova-compute[74701]:   <uuid>b23fe2b9-0d92-4775-a2f0-baacac4db248</uuid>
Oct 20 13:39:29 user nova-compute[74701]:   <name>instance-0000002f</name>
Oct 20 13:39:29 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:39:29 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:39:29 user nova-compute[74701]:   <metadata>
Oct 20 13:39:29 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:39:29 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-65747615</nova:name>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:39:28</nova:creationTime>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:39:29 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:39:29 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:owner>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:39:29 user nova-compute[74701]:       </nova:owner>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:root type="image" uuid="76a6c985-f466-4dc1-a163-05894aef26e4"/>
Oct 20 13:39:29 user nova-compute[74701]:       <nova:ports>
Oct 20 13:39:29 user nova-compute[74701]:         <nova:port uuid="75c9ea23-5e93-45a9-9731-6dc0196e7070">
Oct 20 13:39:29 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 13:39:29 user nova-compute[74701]:         </nova:port>
Oct 20 13:39:29 user nova-compute[74701]:       </nova:ports>
Oct 20 13:39:29 user nova-compute[74701]:     </nova:instance>
Oct 20 13:39:29 user nova-compute[74701]:   </metadata>
Oct 20 13:39:29 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:39:29 user nova-compute[74701]:     <system>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="serial">b23fe2b9-0d92-4775-a2f0-baacac4db248</entry>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="uuid">b23fe2b9-0d92-4775-a2f0-baacac4db248</entry>
Oct 20 13:39:29 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:39:29 user nova-compute[74701]:     </system>
Oct 20 13:39:29 user nova-compute[74701]:   </sysinfo>
Oct 20 13:39:29 user nova-compute[74701]:   <os>
Oct 20 13:39:29 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:39:29 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:39:29 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:39:29 user nova-compute[74701]:   </os>
Oct 20 13:39:29 user nova-compute[74701]:   <features>
Oct 20 13:39:29 user nova-compute[74701]:     <acpi/>
Oct 20 13:39:29 user nova-compute[74701]:     <apic/>
Oct 20 13:39:29 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:39:29 user nova-compute[74701]:   </features>
Oct 20 13:39:29 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:39:29 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:39:29 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:39:29 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:39:29 user nova-compute[74701]:   </clock>
Oct 20 13:39:29 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:39:29 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:39:29 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:39:29 user nova-compute[74701]:   </cpu>
Oct 20 13:39:29 user nova-compute[74701]:   <devices>
Oct 20 13:39:29 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:39:29 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:39:29 user nova-compute[74701]:       <source dev="/dev/sdd"/>
Oct 20 13:39:29 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:39:29 user nova-compute[74701]:       <serial>e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c</serial>
Oct 20 13:39:29 user nova-compute[74701]:     </disk>
Oct 20 13:39:29 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:39:29 user nova-compute[74701]:       <mac address="fa:16:3e:93:bd:43"/>
Oct 20 13:39:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:39:29 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:39:29 user nova-compute[74701]:       <target dev="tap75c9ea23-5e"/>
Oct 20 13:39:29 user nova-compute[74701]:     </interface>
Oct 20 13:39:29 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:39:29 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/b23fe2b9-0d92-4775-a2f0-baacac4db248/console.log" append="off"/>
Oct 20 13:39:29 user nova-compute[74701]:     </serial>
Oct 20 13:39:29 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:39:29 user nova-compute[74701]:     <video>
Oct 20 13:39:29 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:39:29 user nova-compute[74701]:     </video>
Oct 20 13:39:29 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:39:29 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:39:29 user nova-compute[74701]:     </rng>
Oct 20 13:39:29 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:39:29 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:39:29 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:39:29 user nova-compute[74701]:     </memballoon>
Oct 20 13:39:29 user nova-compute[74701]:   </devices>
Oct 20 13:39:29 user nova-compute[74701]: </domain>
Oct 20 13:39:29 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-65747615',id=47,image_ref='76a6c985-f466-4dc1-a163-05894aef26e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM51wmdF1mSNxkY5ezscBpRH3E1gnCZUG3ArR+o3rAKducHE/vX/tzISl33+QUIDAw/n0D1ftrQvXqiPRompg12WvCMnSjDNvJe3eKfF4cjtdoH1Ukwog+OvZf5A5NKWJA==',key_name='tempest-keypair-753374367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-borrrrtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725340178',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=b23fe2b9-0d92-4775-a2f0-baacac4db248,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG os_vif [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c128f112-5067-5697-aedd-94652a6740fd', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75c9ea23-5e, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75c9ea23-5e, col_values=(('qos', UUID('f5ee826f-0549-4a30-912c-0008730c397e')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75c9ea23-5e, col_values=(('external_ids', {'iface-id': '75c9ea23-5e93-45a9-9731-6dc0196e7070', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:bd:43', 'vm-uuid': 'b23fe2b9-0d92-4775-a2f0-baacac4db248'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:29 user nova-compute[74701]: INFO os_vif [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e')
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:39:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:93:bd:43, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:39:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:31 user nova-compute[74701]: DEBUG nova.compute.manager [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] No waiting events found dispatching network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:31 user nova-compute[74701]: WARNING nova.compute.manager [req-96d328cf-7cc6-46bd-a249-9c0195890d63 req-a0cb4260-9797-44e0-be00-ce5ec5a6948f service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received unexpected event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 for instance with vm_state building and task_state spawning.
Oct 20 13:39:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:39:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:39:32 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Instance spawned successfully.
Oct 20 13:39:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:39:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:39:32 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:39:33 user nova-compute[74701]: INFO nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 20 13:39:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:39:33 user nova-compute[74701]: INFO nova.compute.manager [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Took 28.38 seconds to build instance.
Oct 20 13:39:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7dc232c7-5f18-4be4-8ad4-5b7aa2a7cb6e tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.468s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:39:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:39:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:39:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:39:33 user nova-compute[74701]: DEBUG nova.compute.manager [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] No waiting events found dispatching network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:39:33 user nova-compute[74701]: WARNING nova.compute.manager [req-76fe556f-f307-40d0-8f2d-9395e56bb766 req-b1b32a30-d7f0-468a-a4a6-348489b4e416 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received unexpected event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 for instance with vm_state active and task_state None.
Oct 20 13:39:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:38 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:39:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:39:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:40:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:40:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:40:16 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:40:16 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.027843475341797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2964fbe-707b-4c90-878b-10608b2842e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2b24a52-b82a-47eb-9e47-4ca49c469fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance b23fe2b9-0d92-4775-a2f0-baacac4db248 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:40:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:40:19 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:40:20 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:40:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:40:20 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:40:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:39 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:40:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG nova.compute.manager [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing instance network info cache due to event network-changed-82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] Acquiring lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] Acquired lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG nova.network.neutron [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Refreshing network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:46 user nova-compute[74701]: INFO nova.compute.manager [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Terminating instance
Oct 20 13:40:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updated VIF entry in instance network info cache for port 82afa982-0b78-4dd5-ba34-883b7de5204f. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.network.neutron [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [{"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f321d92f-befd-4d17-bc4c-1d5e6fcb5888 req-27b27500-79d5-422b-9b75-ab0f187e1d0e service nova] Releasing lock "refresh_cache-f2b24a52-b82a-47eb-9e47-4ca49c469fff" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:40:47 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Instance destroyed successfully.
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lazy-loading 'resources' on Instance uuid f2b24a52-b82a-47eb-9e47-4ca49c469fff {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1770888340',display_name='tempest-TestShelveInstance-server-1770888340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1770888340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsq2RFUZmY7N4rDyg+VaerPnVzQAw6GID09vF4haNySWIqs830c3htSUZrpLOLrzLcX7dLzE3hoZddsP9lVm24nXOZZlBCv0oqwG3xZiuOSYal0TAYOyeVINHd484OsUA==',key_name='tempest-TestShelveInstance-581037021',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00ddc21f84c429e95e17cd7018c2165',ramdisk_id='',reservation_id='r-u8d0oxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2036929292',owner_user_name='tempest-TestShelveInstance-2036929292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:39:20Z,user_data=None,user_id='34ba26330a2c4ca19f416307b591573d',uuid=f2b24a52-b82a-47eb-9e47-4ca49c469fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converting VIF {"id": "82afa982-0b78-4dd5-ba34-883b7de5204f", "address": "fa:16:3e:2f:c9:af", "network": {"id": "431bd66a-c9d3-45f7-aef4-b83c1ec07437", "bridge": "br-int", "label": "tempest-TestShelveInstance-1560280405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ddc21f84c429e95e17cd7018c2165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82afa982-0b", "ovs_interfaceid": "82afa982-0b78-4dd5-ba34-883b7de5204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_vif [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82afa982-0b, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5892f0b4-562b-45b3-9737-72cda634bffd) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:47 user nova-compute[74701]: INFO os_vif [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:c9:af,bridge_name='br-int',has_traffic_filtering=True,id=82afa982-0b78-4dd5-ba34-883b7de5204f,network=Network(431bd66a-c9d3-45f7-aef4-b83c1ec07437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82afa982-0b')
Oct 20 13:40:47 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGytrsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:40:47 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a063d-e823-4ae0-894f-ece760d73f69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:40:47 user nova-compute[74701]: No targets found.
Oct 20 13:40:47 user nova-compute[74701]: iSNS:
Oct 20 13:40:47 user nova-compute[74701]: No targets found.
Oct 20 13:40:47 user nova-compute[74701]: STATIC:
Oct 20 13:40:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29
Oct 20 13:40:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:40:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:40:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c
Oct 20 13:40:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:40:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:40:47 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4
Oct 20 13:40:47 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:40:47 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:40:47 user nova-compute[74701]: FIRMWARE:
Oct 20 13:40:47 user nova-compute[74701]: No targets found.
Oct 20 13:40:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:40:47 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:40:47 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0365c69c-2f6d-4e76-9739-4506324034cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f503abc4-5dc4-42e9-b849-1ae9c0afbf02]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:40:47 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:40:47 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:40:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:40:47 user nova-compute[74701]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 (non-flash)
Oct 20 13:40:47 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:40:47 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc686200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf26bc-3cc7-4156-88d8-fc686faadc0e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa578b-188a-44b8-9aac-01e54ac148d5]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f6c92-ccc0-4985-aefd-712e7d3ab618]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9d550a-fb0d-40e1-b5b3-69745eb93c30]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26336326531313365', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_400357b2', '/dev/disk/by-id/scsi-1SCST_BIO400357b2-c62e113e1a85bbf0') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf81c10-2f05-4f98-b345-299998f7cc58]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:40:47 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e2e4c-4438-472e-84a1-91dd23f690ef]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca596fce-7c1f-40fa-ad86-fae4aeda4996]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260]
Oct 20 13:40:48 user nova-compute[74701]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4, portal: 172.16.0.220,3260] successful.
Oct 20 13:40:48 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8577724-c6ee-4b66-a2c5-6e9553023fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[024b89d3-ea16-49c5-b46f-a7662491a414]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] <== disconnect_volume: return (302ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:40:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deleting instance files /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff_del
Oct 20 13:40:48 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deletion of /opt/stack/data/nova/instances/f2b24a52-b82a-47eb-9e47-4ca49c469fff_del complete
Oct 20 13:40:48 user nova-compute[74701]: INFO nova.compute.manager [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:48 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Took 0.47 seconds to deallocate network for instance.
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-unplugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Acquiring lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] No waiting events found dispatching network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:40:48 user nova-compute[74701]: WARNING nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received unexpected event network-vif-plugged-82afa982-0b78-4dd5-ba34-883b7de5204f for instance with vm_state active and task_state deleting.
Oct 20 13:40:48 user nova-compute[74701]: DEBUG nova.compute.manager [req-06594417-86c8-4671-b8df-a2ce0bb0d65f req-be6bffa2-f5f2-4193-a1f6-e54902e2d35d service nova] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Received event network-vif-deleted-82afa982-0b78-4dd5-ba34-883b7de5204f {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:49 user nova-compute[74701]: INFO nova.compute.manager [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 13:40:49 user nova-compute[74701]: DEBUG nova.compute.manager [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] [instance: f2b24a52-b82a-47eb-9e47-4ca49c469fff] Deleting volume: e8577724-c6ee-4b66-a2c5-6e9553023fe4 {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:40:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:49 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:40:49 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:40:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:49 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Deleted allocations for instance f2b24a52-b82a-47eb-9e47-4ca49c469fff
Oct 20 13:40:49 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-25fd348c-d750-4654-a2e1-10d0f810dc39 tempest-TestShelveInstance-2036929292 tempest-TestShelveInstance-2036929292-project-member] Lock "f2b24a52-b82a-47eb-9e47-4ca49c469fff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-changed-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:55 user nova-compute[74701]: DEBUG nova.compute.manager [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Refreshing instance network info cache due to event network-changed-75c9ea23-5e93-45a9-9731-6dc0196e7070. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:40:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] Acquiring lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:40:55 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] Acquired lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:40:55 user nova-compute[74701]: DEBUG nova.network.neutron [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Refreshing network info cache for port 75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updated VIF entry in instance network info cache for port 75c9ea23-5e93-45a9-9731-6dc0196e7070. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.network.neutron [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating instance_info_cache with network_info: [{"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-64940349-7536-429c-ba7f-39f301c3d3e7 req-501e95e7-34e6-4186-b01b-d1d7f1090a49 service nova] Releasing lock "refresh_cache-b23fe2b9-0d92-4775-a2f0-baacac4db248" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:56 user nova-compute[74701]: INFO nova.compute.manager [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Terminating instance
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-unplugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] No waiting events found dispatching network-vif-unplugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG nova.compute.manager [req-d3a638a2-a781-4ab5-8e4d-43d3b7fe7bf4 req-799527de-9698-4cd4-9740-9fb9a708d352 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-unplugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:40:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Instance destroyed successfully.
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid b23fe2b9-0d92-4775-a2f0-baacac4db248 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-65747615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-65747615',id=47,image_ref='76a6c985-f466-4dc1-a163-05894aef26e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM51wmdF1mSNxkY5ezscBpRH3E1gnCZUG3ArR+o3rAKducHE/vX/tzISl33+QUIDAw/n0D1ftrQvXqiPRompg12WvCMnSjDNvJe3eKfF4cjtdoH1Ukwog+OvZf5A5NKWJA==',key_name='tempest-keypair-753374367',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-borrrrtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725340178',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=b23fe2b9-0d92-4775-a2f0-baacac4db248,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "address": "fa:16:3e:93:bd:43", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c9ea23-5e", "ovs_interfaceid": "75c9ea23-5e93-45a9-9731-6dc0196e7070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_vif [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75c9ea23-5e, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5ee826f-0549-4a30-912c-0008730c397e) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:40:57 user nova-compute[74701]: INFO os_vif [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:bd:43,bridge_name='br-int',has_traffic_filtering=True,id=75c9ea23-5e93-45a9-9731-6dc0196e7070,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c9ea23-5e')
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbkGUZdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:40:57 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a968bc1b-344d-4328-be03-988ab6fdf5c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:40:57 user nova-compute[74701]: No targets found.
Oct 20 13:40:57 user nova-compute[74701]: iSNS:
Oct 20 13:40:57 user nova-compute[74701]: No targets found.
Oct 20 13:40:57 user nova-compute[74701]: STATIC:
Oct 20 13:40:57 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29
Oct 20 13:40:57 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:40:57 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:40:57 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c
Oct 20 13:40:57 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:40:57 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:40:57 user nova-compute[74701]: FIRMWARE:
Oct 20 13:40:57 user nova-compute[74701]: No targets found.
Oct 20 13:40:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:40:57 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:40:57 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8c5892-c715-45f6-9da2-451ae745339f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a245dcae-e374-4408-b99e-78cf8f0a6b7c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:40:57 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:40:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:40:57 user nova-compute[74701]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c (non-flash)
Oct 20 13:40:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02f4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[97488bb2-a6e6-486e-8673-d5c1d482008f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006d6c1-e2e5-476b-b4e9-05c8d5f129c2]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f327e-e51f-4f89-b32f-a5aee83ca24c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa678d5-b620-443e-8704-3f0395852306]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26630666539323639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdbfe97e', '/dev/disk/by-id/scsi-1SCST_BIObdbfe97e-f0fe9269b9095894') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8b61d-a401-4f19-8d76-59b693492069]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b944de-0e5f-4264-9b9d-bc6887464f07]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90483bb-950d-46f5-ae35-e8cb8f90ab53]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260]
Oct 20 13:40:57 user nova-compute[74701]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c, portal: 172.16.0.220,3260] successful.
Oct 20 13:40:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2dbeb4-5f76-4b4f-a215-bc48843c9c9e]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (347ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:40:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Deleting instance files /opt/stack/data/nova/instances/b23fe2b9-0d92-4775-a2f0-baacac4db248_del
Oct 20 13:40:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Deletion of /opt/stack/data/nova/instances/b23fe2b9-0d92-4775-a2f0-baacac4db248_del complete
Oct 20 13:40:57 user nova-compute[74701]: INFO nova.compute.manager [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 20 13:40:57 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:40:57 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:40:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9a48137-c0bc-41a8-a01f-375fd19f3579 req-e7f997ba-1ba9-44bc-98a7-aa6461967377 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-deleted-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:58 user nova-compute[74701]: INFO nova.compute.manager [req-b9a48137-c0bc-41a8-a01f-375fd19f3579 req-e7f997ba-1ba9-44bc-98a7-aa6461967377 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Neutron deleted interface 75c9ea23-5e93-45a9-9731-6dc0196e7070; detaching it from the instance and deleting it from the info cache
Oct 20 13:40:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-b9a48137-c0bc-41a8-a01f-375fd19f3579 req-e7f997ba-1ba9-44bc-98a7-aa6461967377 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:58 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:40:58 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Took 0.71 seconds to deallocate network for instance.
Oct 20 13:40:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-b9a48137-c0bc-41a8-a01f-375fd19f3579 req-e7f997ba-1ba9-44bc-98a7-aa6461967377 service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Detach interface failed, port_id=75c9ea23-5e93-45a9-9731-6dc0196e7070, reason: Instance b23fe2b9-0d92-4775-a2f0-baacac4db248 could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] Acquiring lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] No waiting events found dispatching network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:40:59 user nova-compute[74701]: WARNING nova.compute.manager [req-920acbb2-77e0-416c-9d29-634fc34a7ff2 req-99038d62-0c46-4691-8e24-3370e257be5c service nova] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Received unexpected event network-vif-plugged-75c9ea23-5e93-45a9-9731-6dc0196e7070 for instance with vm_state active and task_state deleting.
Oct 20 13:40:59 user nova-compute[74701]: INFO nova.compute.manager [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Took 0.96 seconds to detach 1 volumes for instance.
Oct 20 13:40:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: b23fe2b9-0d92-4775-a2f0-baacac4db248] Deleting volume: e10053a9-5b83-40cd-8f80-ed0eb6ee6a6c {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:40:59 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance b23fe2b9-0d92-4775-a2f0-baacac4db248
Oct 20 13:40:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ef-2bf4-4b42-83d8-fa83710ffacf tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "b23fe2b9-0d92-4775-a2f0-baacac4db248" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.329s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:41:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:41:17 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:41:17 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.017959594726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance f2964fbe-707b-4c90-878b-10608b2842e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:41:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:41:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:41:21 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [{"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-f2964fbe-707b-4c90-878b-10608b2842e4" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:41:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:41:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:39 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Verify base images {{(pid=74701) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74701) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] f2964fbe-707b-4c90-878b-10608b2842e4 is a valid instance name {{(pid=74701) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315
Oct 20 13:41:45 user nova-compute[74701]: WARNING nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Removable base files: /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04 /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926 /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897 /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315 /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c412c19795cfbbf56162719b40b7fbd62e268a04
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71d991d9272332c833115f1bec112185408c2926
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d63de64a61e980382d4fdeee383c4df75cb44897
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/984b3f0a3f4c41fb0ce577af0573eff5a33d543c
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b8f44f38e73dfee66f96d0062df5ad933b1d58b
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/077ad8e1cf2a6deb8e064147e4869a702297b315
Oct 20 13:41:45 user nova-compute[74701]: INFO nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8a0b871f8d331ee3461fbb3523bf1a47c4ce4e82
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Verification complete {{(pid=74701) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Verify swap images {{(pid=74701) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 13:41:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.imagecache [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Verify ephemeral images {{(pid=74701) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 13:41:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:41:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:56 user nova-compute[74701]: INFO nova.compute.manager [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Terminating instance
Oct 20 13:41:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-unplugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] No waiting events found dispatching network-vif-unplugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.compute.manager [req-a861a882-5076-4f77-a337-a12f6fe82b85 req-b3e92da6-f7d8-462d-adea-db2328fc53da service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-unplugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:41:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Instance destroyed successfully.
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.objects.instance [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid f2964fbe-707b-4c90-878b-10608b2842e4 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-962269315',display_name='tempest-TestVolumeBootPattern-volume-backed-server-962269315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-962269315',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLVpG3M/UGAmYYW8HwEol0ZFttSXD9+z8CYdp9JnD+ThQ3HZKqknlMs9sQfyEyZGw+qUBFuTxg2AcF7WbIEHD4UlE6A7Invr3oU63SRUIFNo55YAy853UL+NIVo6HJXHA==',key_name='tempest-keypair-552943348',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-8pnwbrt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=f2964fbe-707b-4c90-878b-10608b2842e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "address": "fa:16:3e:ea:1e:08", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e31e8ef-5e", "ovs_interfaceid": "2e31e8ef-5e96-4ab3-a0d0-1de15af11607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_vif [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e31e8ef-5e, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb0b0116-1c95-4399-b1a2-7ad3d67eb964) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:41:57 user nova-compute[74701]: INFO os_vif [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=2e31e8ef-5e96-4ab3-a0d0-1de15af11607,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e31e8ef-5e')
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcjvrNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:41:57 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6bfd6-a96b-4021-8564-c44ddc29a49d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:41:57 user nova-compute[74701]: No targets found.
Oct 20 13:41:57 user nova-compute[74701]: iSNS:
Oct 20 13:41:57 user nova-compute[74701]: No targets found.
Oct 20 13:41:57 user nova-compute[74701]: STATIC:
Oct 20 13:41:57 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29
Oct 20 13:41:57 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:41:57 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:41:57 user nova-compute[74701]: FIRMWARE:
Oct 20 13:41:57 user nova-compute[74701]: No targets found.
Oct 20 13:41:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:41:57 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:41:57 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0a4f1-7148-4a6c-8084-72004cc1f752]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[63063a42-6a42-4028-b3d8-f41414463d7e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:41:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 (non-flash)
Oct 20 13:41:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e07cf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d228de5c-fd00-49e1-b981-677876ffdb22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179532c-b80c-4e54-a56b-f117ea10935f]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82b88d-f344-4d56-a2be-cf1e6c1ff858]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c497a-2e17-4135-a4db-062b661aa47f]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_196784e1', '/dev/disk/by-id/scsi-1SCST_BIO196784e1-e48f61583df0957c', '/dev/disk/by-id/scsi-26534386636313538') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee01fe-fee3-4043-b2e0-eccdaf3c3912]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a41b721-6419-4102-abb1-7fad08ac2b1a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d504f13-6f3b-4e01-9362-38758df258ff]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260]
Oct 20 13:41:57 user nova-compute[74701]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29, portal: 172.16.0.220,3260] successful.
Oct 20 13:41:57 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8459755a-4e70-466d-bc79-853e5259aa29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0796de-ba7b-41ac-bea0-2b06c0c1b5de]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (320ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:41:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Deleting instance files /opt/stack/data/nova/instances/f2964fbe-707b-4c90-878b-10608b2842e4_del
Oct 20 13:41:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Deletion of /opt/stack/data/nova/instances/f2964fbe-707b-4c90-878b-10608b2842e4_del complete
Oct 20 13:41:57 user nova-compute[74701]: INFO nova.compute.manager [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 20 13:41:57 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:41:57 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:41:58 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:41:58 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Took 1.03 seconds to deallocate network for instance.
Oct 20 13:41:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-76f6e832-cb5a-4895-a6f4-426c8faf64fa req-63a01e33-3f6e-4713-a474-39d6a5a15a22 service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-deleted-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] Acquiring lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] Lock "f2964fbe-707b-4c90-878b-10608b2842e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] No waiting events found dispatching network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:41:59 user nova-compute[74701]: WARNING nova.compute.manager [req-90cf1fc9-e1b8-457b-9f79-a6216983bc40 req-f59790d5-e83f-4e26-aef2-f04888ced7a1 service nova] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Received unexpected event network-vif-plugged-2e31e8ef-5e96-4ab3-a0d0-1de15af11607 for instance with vm_state active and task_state deleting.
Oct 20 13:41:59 user nova-compute[74701]: INFO nova.compute.manager [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Took 0.80 seconds to detach 1 volumes for instance.
Oct 20 13:41:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: f2964fbe-707b-4c90-878b-10608b2842e4] Deleting volume: 8459755a-4e70-466d-bc79-853e5259aa29 {{(pid=74701) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:41:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:41:59 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance f2964fbe-707b-4c90-878b-10608b2842e4
Oct 20 13:42:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-b3fee814-575d-4b55-bfc7-86ce12b0c1b6 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "f2964fbe-707b-4c90-878b-10608b2842e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.455s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:42:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:42:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:42:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:42:18 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:42:19 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:42:19 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9058MB free_disk=25.014907836914062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:42:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:42:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:42:21 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:42:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:42:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:42:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:26 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:40 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:42:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:42:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:43:07 user nova-compute[74701]: INFO nova.compute.claims [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Claim successful on node user
Oct 20 13:43:07 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:43:07 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:43:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:43:08 user nova-compute[74701]: INFO nova.virt.block_device [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Booting with volume 8fef76f8-6f2f-4fc7-afce-49b38bbbd529 at /dev/vda
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.policy [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.utils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460dce0-3add-4c62-b830-a9ecd9b80313]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa914f5a-20ef-4a24-85b4-31eb9d09b03f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e2474-c0d4-48cf-8521-e06a7ed680e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5f57f-654f-40f3-ac44-54fb14a4626f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:43:08 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:43:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca73cfca-7665-4c4a-8ea7-d1c4df68e88c]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG os_brick.utils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating existing volume attachment record: 66f68fcf-7fe9-41e6-b00c-013b76af3fcf {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:43:08 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Successfully created port: 220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Successfully updated port: 220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-changed-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG nova.compute.manager [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Refreshing instance network info cache due to event network-changed-220b07aa-0422-430c-96c6-b643a8208696. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] Acquiring lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:43:09 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating instance_info_cache with network_info: [{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Instance network_info: |[{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] Acquired lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Refreshing network info cache for port 220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updated VIF entry in instance network info cache for port 220b07aa-0422-430c-96c6-b643a8208696. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG nova.network.neutron [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating instance_info_cache with network_info: [{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:43:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-c151ffc2-e941-4366-a2a1-c9156001180d req-3f87d8fc-75db-4945-864f-f1dd531e10a8 service nova] Releasing lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:43:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:18 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:18 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:43:19 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:19 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.004215240478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0521a22a-99a0-418c-b586-3d3ed911ba15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:43:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:22 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:22 user nova-compute[74701]: WARNING nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Oct 20 13:43:22 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 0521a22a-99a0-418c-b586-3d3ed911ba15 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:43:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Skipping network cache update for instance because it is Building. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:43:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:24 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:43:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Creating image(s)
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Ensure instance console log exists: /opt/stack/data/nova/instances/0521a22a-99a0-418c-b586-3d3ed911ba15/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Start _get_guest_xml network_info=[{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0521a22a-99a0-418c-b586-3d3ed911ba15', 'attached_at': '', 'detached_at': '', 'volume_id': '8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'serial': '8fef76f8-6f2f-4fc7-afce-49b38bbbd529'}, 'attachment_id': '66f68fcf-7fe9-41e6-b00c-013b76af3fcf', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:43:25 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:25 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:43:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:43:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:43:25 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[95984855-7db5-4ba2-aa6a-281e31683dff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:43:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f10572-8794-4f55-8dde-fb62e7da409e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529] added
Oct 20 13:43:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e816e61-dec8-45a3-8b3b-878f86fea136]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6108c77-978a-4d13-be6e-61dd3ded5ce9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyeCZrbj {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyeCZrbj" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[020d4633-1c03-494d-8328-19385b340fe7]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyeCZrbj'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d5168a-cd20-4cae-8b1d-2ccdaecb427c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c175afe-0642-48ee-8057-bc8060f7ab5b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:43:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:43:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:43:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:43:25 user nova-compute[74701]: 
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b066aa98-1cfc-4281-ab84-66af2aab7082]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]
Oct 20 13:43:25 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.
Oct 20 13:43:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8ca43-f487-4b7e-acdc-9581bea626e9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f5fdf-3f08-49a8-bf8a-e270c0c89a24]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:43:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:43:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:43:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:26 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c909e-5b49-4e19-8bcc-9d9f3499317a]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:43:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:43:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:43:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23131356333396366', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131356333396366', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357716707',display_name='tempest-TestVolumeBootPattern-server-357716707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357716707',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-rxrgyun4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:43:08Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=0521a22a-99a0-418c-b586-3d3ed911ba15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid 0521a22a-99a0-418c-b586-3d3ed911ba15 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:43:27 user nova-compute[74701]:   <uuid>0521a22a-99a0-418c-b586-3d3ed911ba15</uuid>
Oct 20 13:43:27 user nova-compute[74701]:   <name>instance-00000030</name>
Oct 20 13:43:27 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:43:27 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:43:27 user nova-compute[74701]:   <metadata>
Oct 20 13:43:27 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:43:27 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:43:27 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-server-357716707</nova:name>
Oct 20 13:43:27 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:43:25</nova:creationTime>
Oct 20 13:43:27 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:43:27 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:43:27 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:43:27 user nova-compute[74701]:       <nova:owner>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:43:27 user nova-compute[74701]:       </nova:owner>
Oct 20 13:43:27 user nova-compute[74701]:       <nova:ports>
Oct 20 13:43:27 user nova-compute[74701]:         <nova:port uuid="220b07aa-0422-430c-96c6-b643a8208696">
Oct 20 13:43:27 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:43:27 user nova-compute[74701]:         </nova:port>
Oct 20 13:43:27 user nova-compute[74701]:       </nova:ports>
Oct 20 13:43:27 user nova-compute[74701]:     </nova:instance>
Oct 20 13:43:27 user nova-compute[74701]:   </metadata>
Oct 20 13:43:27 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:43:27 user nova-compute[74701]:     <system>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="serial">0521a22a-99a0-418c-b586-3d3ed911ba15</entry>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="uuid">0521a22a-99a0-418c-b586-3d3ed911ba15</entry>
Oct 20 13:43:27 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:43:27 user nova-compute[74701]:     </system>
Oct 20 13:43:27 user nova-compute[74701]:   </sysinfo>
Oct 20 13:43:27 user nova-compute[74701]:   <os>
Oct 20 13:43:27 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:43:27 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:43:27 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:43:27 user nova-compute[74701]:   </os>
Oct 20 13:43:27 user nova-compute[74701]:   <features>
Oct 20 13:43:27 user nova-compute[74701]:     <acpi/>
Oct 20 13:43:27 user nova-compute[74701]:     <apic/>
Oct 20 13:43:27 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:43:27 user nova-compute[74701]:   </features>
Oct 20 13:43:27 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:43:27 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:43:27 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:43:27 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:43:27 user nova-compute[74701]:   </clock>
Oct 20 13:43:27 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:43:27 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:43:27 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:43:27 user nova-compute[74701]:   </cpu>
Oct 20 13:43:27 user nova-compute[74701]:   <devices>
Oct 20 13:43:27 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:43:27 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:43:27 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:43:27 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:43:27 user nova-compute[74701]:       <serial>8fef76f8-6f2f-4fc7-afce-49b38bbbd529</serial>
Oct 20 13:43:27 user nova-compute[74701]:     </disk>
Oct 20 13:43:27 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:43:27 user nova-compute[74701]:       <mac address="fa:16:3e:bb:21:6b"/>
Oct 20 13:43:27 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:43:27 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:43:27 user nova-compute[74701]:       <target dev="tap220b07aa-04"/>
Oct 20 13:43:27 user nova-compute[74701]:     </interface>
Oct 20 13:43:27 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:43:27 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/0521a22a-99a0-418c-b586-3d3ed911ba15/console.log" append="off"/>
Oct 20 13:43:27 user nova-compute[74701]:     </serial>
Oct 20 13:43:27 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:43:27 user nova-compute[74701]:     <video>
Oct 20 13:43:27 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:43:27 user nova-compute[74701]:     </video>
Oct 20 13:43:27 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:43:27 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:43:27 user nova-compute[74701]:     </rng>
Oct 20 13:43:27 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:43:27 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:43:27 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:43:27 user nova-compute[74701]:     </memballoon>
Oct 20 13:43:27 user nova-compute[74701]:   </devices>
Oct 20 13:43:27 user nova-compute[74701]: </domain>
Oct 20 13:43:27 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357716707',display_name='tempest-TestVolumeBootPattern-server-357716707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357716707',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-rxrgyun4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:43:08Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=0521a22a-99a0-418c-b586-3d3ed911ba15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG os_vif [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dccffd79-cc07-506e-ac8e-d864b10fe074', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap220b07aa-04, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap220b07aa-04, col_values=(('qos', UUID('4446c516-ba77-4b43-a930-351982246501')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap220b07aa-04, col_values=(('external_ids', {'iface-id': '220b07aa-0422-430c-96c6-b643a8208696', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:21:6b', 'vm-uuid': '0521a22a-99a0-418c-b586-3d3ed911ba15'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:27 user nova-compute[74701]: INFO os_vif [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04')
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:bb:21:6b, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:43:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:28 user nova-compute[74701]: DEBUG nova.compute.manager [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] No waiting events found dispatching network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:43:28 user nova-compute[74701]: WARNING nova.compute.manager [req-855bee16-7989-4950-bb5f-b05f079bf64a req-dbf6f6c7-33d7-4e7a-8319-ee2af0862fd8 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received unexpected event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 for instance with vm_state building and task_state spawning.
Oct 20 13:43:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:43:30 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Instance spawned successfully.
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:30 user nova-compute[74701]: INFO nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Took 5.09 seconds to spawn the instance on the hypervisor.
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:43:30 user nova-compute[74701]: INFO nova.compute.manager [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Took 23.04 seconds to build instance.
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-8631f8bf-e47b-4a7a-a94a-852438a46218 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.155s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.736s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:30 user nova-compute[74701]: INFO nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] No waiting events found dispatching network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:43:30 user nova-compute[74701]: WARNING nova.compute.manager [req-f7d903b0-22c6-4e0f-88bf-ca20d9f23a97 req-decd9915-a640-48cc-8412-0134bbcfb751 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received unexpected event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 for instance with vm_state active and task_state None.
Oct 20 13:43:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:32 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:43:32 user nova-compute[74701]: INFO nova.compute.claims [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Claim successful on node user
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:43:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.policy [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66b5f73e271a42eab0d3733e60317550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04195d30b684d72b548c2d11dca2b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:43:33 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Creating image(s)
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Successfully created port: d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.virt.images [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] 739adbf0-3010-4fda-8848-c5d35e115e61 was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.part /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.part /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.converted" returned: 0 in 0.300s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Successfully updated port: d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.195s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.compute.manager [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing instance network info cache due to event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json" returned: 0 in 0.182s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:34 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c,backing_fmt=raw /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c,backing_fmt=raw /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk 1073741824" returned: 0 in 0.053s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "8a7564dd244f6e46f35c2162f66fb29babb67c1c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance network_info: |[{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json" returned: 0 in 0.203s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Cannot resize image /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Ensure instance console log exists: /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start _get_guest_xml network_info=[{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:43:30Z,direct_url=<?>,disk_format='qcow2',id=739adbf0-3010-4fda-8848-c5d35e115e61,min_disk=0,min_ram=0,name='tempest-scenario-img--2115851464',owner='f04195d30b684d72b548c2d11dca2b43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:43:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '739adbf0-3010-4fda-8848-c5d35e115e61'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:43:35 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:35 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:43:30Z,direct_url=<?>,disk_format='qcow2',id=739adbf0-3010-4fda-8848-c5d35e115e61,min_disk=0,min_ram=0,name='tempest-scenario-img--2115851464',owner='f04195d30b684d72b548c2d11dca2b43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:43:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:43:33Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'pci_devices' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated VIF entry in instance network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.neutron [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:43:35 user nova-compute[74701]:   <uuid>145a0db7-fbd9-439f-a869-f76a2d41c9bf</uuid>
Oct 20 13:43:35 user nova-compute[74701]:   <name>instance-00000031</name>
Oct 20 13:43:35 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:43:35 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:43:35 user nova-compute[74701]:   <metadata>
Oct 20 13:43:35 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:43:35 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:name>tempest-TestMinimumBasicScenario-server-459358787</nova:name>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:43:35</nova:creationTime>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:43:35 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:43:35 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:owner>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:user uuid="66b5f73e271a42eab0d3733e60317550">tempest-TestMinimumBasicScenario-76758976-project-member</nova:user>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:project uuid="f04195d30b684d72b548c2d11dca2b43">tempest-TestMinimumBasicScenario-76758976</nova:project>
Oct 20 13:43:35 user nova-compute[74701]:       </nova:owner>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:root type="image" uuid="739adbf0-3010-4fda-8848-c5d35e115e61"/>
Oct 20 13:43:35 user nova-compute[74701]:       <nova:ports>
Oct 20 13:43:35 user nova-compute[74701]:         <nova:port uuid="d6a5abda-c679-4e7e-97f4-fe7fe45aac58">
Oct 20 13:43:35 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:43:35 user nova-compute[74701]:         </nova:port>
Oct 20 13:43:35 user nova-compute[74701]:       </nova:ports>
Oct 20 13:43:35 user nova-compute[74701]:     </nova:instance>
Oct 20 13:43:35 user nova-compute[74701]:   </metadata>
Oct 20 13:43:35 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:43:35 user nova-compute[74701]:     <system>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="serial">145a0db7-fbd9-439f-a869-f76a2d41c9bf</entry>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="uuid">145a0db7-fbd9-439f-a869-f76a2d41c9bf</entry>
Oct 20 13:43:35 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:43:35 user nova-compute[74701]:     </system>
Oct 20 13:43:35 user nova-compute[74701]:   </sysinfo>
Oct 20 13:43:35 user nova-compute[74701]:   <os>
Oct 20 13:43:35 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:43:35 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:43:35 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:43:35 user nova-compute[74701]:   </os>
Oct 20 13:43:35 user nova-compute[74701]:   <features>
Oct 20 13:43:35 user nova-compute[74701]:     <acpi/>
Oct 20 13:43:35 user nova-compute[74701]:     <apic/>
Oct 20 13:43:35 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:43:35 user nova-compute[74701]:   </features>
Oct 20 13:43:35 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:43:35 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:43:35 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:43:35 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:43:35 user nova-compute[74701]:   </clock>
Oct 20 13:43:35 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:43:35 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:43:35 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:43:35 user nova-compute[74701]:   </cpu>
Oct 20 13:43:35 user nova-compute[74701]:   <devices>
Oct 20 13:43:35 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:43:35 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:43:35 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk"/>
Oct 20 13:43:35 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:43:35 user nova-compute[74701]:     </disk>
Oct 20 13:43:35 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:43:35 user nova-compute[74701]:       <mac address="fa:16:3e:c3:74:8d"/>
Oct 20 13:43:35 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:43:35 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:43:35 user nova-compute[74701]:       <target dev="tapd6a5abda-c6"/>
Oct 20 13:43:35 user nova-compute[74701]:     </interface>
Oct 20 13:43:35 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:43:35 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/console.log" append="off"/>
Oct 20 13:43:35 user nova-compute[74701]:     </serial>
Oct 20 13:43:35 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:43:35 user nova-compute[74701]:     <video>
Oct 20 13:43:35 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:43:35 user nova-compute[74701]:     </video>
Oct 20 13:43:35 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:43:35 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:43:35 user nova-compute[74701]:     </rng>
Oct 20 13:43:35 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:43:35 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:43:35 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:43:35 user nova-compute[74701]:     </memballoon>
Oct 20 13:43:35 user nova-compute[74701]:   </devices>
Oct 20 13:43:35 user nova-compute[74701]: </domain>
Oct 20 13:43:35 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:43:33Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG os_vif [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6f04d914-9533-456e-8367-d9f442f21108 req-132656f6-a443-44fb-b08c-326dbe310272 service nova] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad5fa02c-1623-5d9f-af6c-212443696937', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6a5abda-c6, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6a5abda-c6, col_values=(('qos', UUID('169eadcc-bd79-4fed-b692-fdc6cfb99af8')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6a5abda-c6, col_values=(('external_ids', {'iface-id': 'd6a5abda-c679-4e7e-97f4-fe7fe45aac58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:74:8d', 'vm-uuid': '145a0db7-fbd9-439f-a869-f76a2d41c9bf'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:35 user nova-compute[74701]: INFO os_vif [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6')
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:43:35 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No VIF found with MAC fa:16:3e:c3:74:8d, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:43:37 user nova-compute[74701]: WARNING nova.compute.manager [req-76c95330-01f6-4473-9127-dc347ac57573 req-aa004387-48c1-4edb-a0c3-838a09088fbf service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state building and task_state spawning.
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:43:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance spawned successfully.
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:43:39 user nova-compute[74701]: WARNING nova.compute.manager [req-ddb10af3-3eb6-41b1-825e-699047c0ff04 req-dedf4b37-17d5-4235-b360-8bdf8238cdfa service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state building and task_state spawning.
Oct 20 13:43:39 user nova-compute[74701]: INFO nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 20 13:43:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:43:39 user nova-compute[74701]: INFO nova.compute.manager [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Took 6.78 seconds to build instance.
Oct 20 13:43:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ed2ee915-661f-4b60-bee3-233a7a5020e8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:43:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:40 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:43:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:43:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:44:19 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:44:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:44:20 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=24.91175079345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 0521a22a-99a0-418c-b586-3d3ed911ba15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:44:20 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:44:21 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:44:21 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:44:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:44:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 0521a22a-99a0-418c-b586-3d3ed911ba15 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating instance_info_cache with network_info: [{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:44:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:44:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:41 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:44:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:44:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:44:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-changed-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.compute.manager [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Refreshing instance network info cache due to event network-changed-220b07aa-0422-430c-96c6-b643a8208696. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] Acquiring lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] Acquired lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Refreshing network info cache for port 220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updated VIF entry in instance network info cache for port 220b07aa-0422-430c-96c6-b643a8208696. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating instance_info_cache with network_info: [{"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-ec7bf5a9-70f6-445e-a571-1f4658b889a6 req-dc3b55bc-8ccd-4dd4-b3a3-35cc2aa59572 service nova] Releasing lock "refresh_cache-0521a22a-99a0-418c-b586-3d3ed911ba15" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:44:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:44:59 user nova-compute[74701]: INFO nova.compute.manager [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Terminating instance
Oct 20 13:44:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-unplugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] No waiting events found dispatching network-vif-unplugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-58543f11-5b5f-4330-92e3-9a037a7ec0c3 req-731d9159-47d2-4fed-bb53-c26250ba4971 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-unplugged-220b07aa-0422-430c-96c6-b643a8208696 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:45:00 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Instance destroyed successfully.
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.objects.instance [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid 0521a22a-99a0-418c-b586-3d3ed911ba15 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357716707',display_name='tempest-TestVolumeBootPattern-server-357716707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357716707',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-rxrgyun4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:43:31Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=0521a22a-99a0-418c-b586-3d3ed911ba15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "220b07aa-0422-430c-96c6-b643a8208696", "address": "fa:16:3e:bb:21:6b", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap220b07aa-04", "ovs_interfaceid": "220b07aa-0422-430c-96c6-b643a8208696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_vif [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap220b07aa-04, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4446c516-ba77-4b43-a930-351982246501) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:00 user nova-compute[74701]: INFO os_vif [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:21:6b,bridge_name='br-int',has_traffic_filtering=True,id=220b07aa-0422-430c-96c6-b643a8208696,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap220b07aa-04')
Oct 20 13:45:00 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:45:00 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9e918-7715-4636-883f-5662ea4a3a72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:45:00 user nova-compute[74701]: No targets found.
Oct 20 13:45:00 user nova-compute[74701]: iSNS:
Oct 20 13:45:00 user nova-compute[74701]: No targets found.
Oct 20 13:45:00 user nova-compute[74701]: STATIC:
Oct 20 13:45:00 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529
Oct 20 13:45:00 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:45:00 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:45:00 user nova-compute[74701]: FIRMWARE:
Oct 20 13:45:00 user nova-compute[74701]: No targets found.
Oct 20 13:45:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:45:00 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:45:00 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c213383-2cdf-43a8-ac83-254dbf944883]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e0ebd1-d868-45f0-a050-bde7164a09ee]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:45:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:45:00 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e061ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a289e-0dab-47cf-8c25-9afb3d2bc439]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad0b931-be7b-40d5-8128-2e2a206f04ae]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd1fb7-ca06-4140-9df0-e52d9c8ae90b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94407db-ef45-48d0-8593-9b6bd892d083]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:00 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e66fd4-8833-4f41-8ed8-f170156e0069]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c422e-01b6-4f66-b362-557dfb382fb5]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]
Oct 20 13:45:01 user nova-compute[74701]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.
Oct 20 13:45:01 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6767bb05-b528-4272-89a0-5aad3b3a8f44]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (311ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:45:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Deleting instance files /opt/stack/data/nova/instances/0521a22a-99a0-418c-b586-3d3ed911ba15_del
Oct 20 13:45:01 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Deletion of /opt/stack/data/nova/instances/0521a22a-99a0-418c-b586-3d3ed911ba15_del complete
Oct 20 13:45:01 user nova-compute[74701]: INFO nova.compute.manager [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 13:45:01 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:45:01 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:45:01 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Took 0.70 seconds to deallocate network for instance.
Oct 20 13:45:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-514872c3-234e-4553-8853-ae3baaba30b1 req-32ed1b2a-87b1-4e93-bc8e-0ea0dd690680 service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-deleted-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] Acquiring lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] No waiting events found dispatching network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:45:02 user nova-compute[74701]: WARNING nova.compute.manager [req-a2ab3d76-490b-4ee3-a5a3-d2872d7ce4c7 req-011499c2-67fc-4652-96a1-7b759dc7049f service nova] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Received unexpected event network-vif-plugged-220b07aa-0422-430c-96c6-b643a8208696 for instance with vm_state active and task_state deleting.
Oct 20 13:45:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:02 user nova-compute[74701]: INFO nova.compute.manager [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 0521a22a-99a0-418c-b586-3d3ed911ba15] Took 0.82 seconds to detach 1 volumes for instance.
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:45:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:02 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance 0521a22a-99a0-418c-b586-3d3ed911ba15
Oct 20 13:45:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-9cafd774-4b29-4b4c-8813-bce4e6ff8643 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "0521a22a-99a0-418c-b586-3d3ed911ba15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:45:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:45:21 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:22 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:45:22 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.910358428955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:45:22 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:27 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:45:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:45:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:45:27 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG nova.objects.instance [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:28 user nova-compute[74701]: INFO nova.compute.manager [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Attaching volume d560888d-30d7-4400-9c3f-7051f547a052 to /dev/vdb
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.utils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e379315c-9337-4743-983c-da973340421f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3cb74-0382-4e08-99f2-8ba3903b7804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b63d0fb-87c9-455e-9f34-69a147487206]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7027c3-8160-470a-8505-6f8bc147bcee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:45:28 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:45:28 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb0b4b2-e68d-482d-9bc3-9e358fcebdc5]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG os_brick.utils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:45:28 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating existing volume attachment record: d8a2fa81-1f73-4a7a-80ab-a20d1bba9da2 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:45:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:45:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:43 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:45:44 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:45:44 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:45:44 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f7cc8-4e49-44bd-85b9-59d13d505ba3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:45:44 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc977f5-4ff2-47f7-b728-32677da9cf5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052] added
Oct 20 13:45:44 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b0ab2-1c8a-46dd-bc43-405a7c87184f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b109700-ceca-4aa5-8c51-39073dd3dac9]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlTbkdmD {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlTbkdmD" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a696e88-8610-4796-86fd-fd5e0a44c045]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlTbkdmD'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c48117e-c053-41b7-abd8-cf079268924b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d599a1-d0a0-4476-ab09-c562f114c8c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:45:44 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:45:44 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:45:44 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:45:44 user nova-compute[74701]: 
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3825979-5468-4274-ad98-8723ea875074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]
Oct 20 13:45:44 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.
Oct 20 13:45:44 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860653f-b57c-4f9b-b894-fb23e22c098f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622df1d-d0a6-47a4-b16a-8602b86d236a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:45:44 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:45:44 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c8a974-114d-42f7-8668-3014166ee5ba]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:45:44 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23661636165346134', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661636165346134', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG nova.objects.instance [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:45:45 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:45:45 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:45:45 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:45:45 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:45:45 user nova-compute[74701]:   <serial>d560888d-30d7-4400-9c3f-7051f547a052</serial>
Oct 20 13:45:45 user nova-compute[74701]: </disk>
Oct 20 13:45:45 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:45:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:45:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:45:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No VIF found with MAC fa:16:3e:c3:74:8d, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:45:46 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-00205eda-622d-4e34-bd08-ef40abc292e7 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.818s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:45:51 user nova-compute[74701]: INFO nova.compute.claims [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Claim successful on node user
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:45:51 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:45:51 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:45:52 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:45:52 user nova-compute[74701]: INFO nova.virt.block_device [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Booting with volume 8fef76f8-6f2f-4fc7-afce-49b38bbbd529 at /dev/vda
Oct 20 13:45:52 user nova-compute[74701]: DEBUG nova.policy [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd1b50-a510-4cb3-b3b2-6f394631b099]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3ebee0-9cd6-42ae-884b-591fd67fd94b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6aa157-17f3-4fd8-b683-b34fc87aac94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4fd9c2-8412-4252-bd52-ab56fdd518aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:45:52 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:45:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3838c5c-3f0c-40b3-a6d6-c6f6769d461d]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating existing volume attachment record: 6ec2a106-e949-4e4c-889b-2a7480424ac6 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:45:52 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Successfully created port: 99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Successfully updated port: 99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing instance network info cache due to event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.network.neutron [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Instance network_info: |[{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:45:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:45:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updated VIF entry in instance network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:45:54 user nova-compute[74701]: DEBUG nova.network.neutron [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:45:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b8373d2f-3c15-4b4d-80f5-8ed88f1f25f6 req-beb36404-ac8f-4b31-bfc1-440a30ab1bbc service nova] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:45:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing instance network info cache due to event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated VIF entry in instance network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG nova.network.neutron [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-0c36e575-383b-4add-844f-3d66478fb630 req-32d774f8-9a2e-4f58-8011-02470977590c service nova] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:45:58 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing instance network info cache due to event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated VIF entry in instance network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-bbe7a90a-1222-429e-9818-722957dfa3fa req-5248e3a9-294b-4078-9990-2388508de3d6 service nova] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:46:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:46:08 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Creating image(s)
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Ensure instance console log exists: /opt/stack/data/nova/instances/5b4f1195-f4db-414d-bd20-6f9393b98b7c/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Start _get_guest_xml network_info=[{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b4f1195-f4db-414d-bd20-6f9393b98b7c', 'attached_at': '', 'detached_at': '', 'volume_id': '8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'serial': '8fef76f8-6f2f-4fc7-afce-49b38bbbd529'}, 'attachment_id': '6ec2a106-e949-4e4c-889b-2a7480424ac6', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:46:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:08 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:46:08 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:46:08 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:46:08 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b991d-b0d5-4ae2-9b7e-1630106123b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:46:08 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a75c4c-1a8b-44a4-a5f0-25b122cc9295]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529] added
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec888ca4-d1e1-4f15-98c8-c3d463c55d0b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad29de9-6468-4e47-8aeb-5d5559583277]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyeCZrbj {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyeCZrbj" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe8c29c-503e-4501-8512-986553728cff]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyeCZrbj'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f6fee-5b10-41d9-b2ae-cd114ac9be08]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8aa077-6f08-463f-bf33-38fd8e635fe7]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c9c30-a2cc-4fbb-b592-81d214cfc9b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]
Oct 20 13:46:08 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8392e-0ad2-4e2d-a265-a5003e7a7adb]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8761a-2599-413f-b2ba-6ee1ec0518a2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:08 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd559182-0ecd-46b2-bf1a-3b6ed1ad4033]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:46:08 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:46:09 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23131356333396366', 'path': '/dev/sdc'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131356333396366', 'path': '/dev/sdc'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-838236975',display_name='tempest-TestVolumeBootPattern-server-838236975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-838236975',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-q1u061tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:45:52Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=5b4f1195-f4db-414d-bd20-6f9393b98b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.objects.instance [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b4f1195-f4db-414d-bd20-6f9393b98b7c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:46:10 user nova-compute[74701]:   <uuid>5b4f1195-f4db-414d-bd20-6f9393b98b7c</uuid>
Oct 20 13:46:10 user nova-compute[74701]:   <name>instance-00000032</name>
Oct 20 13:46:10 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:46:10 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:46:10 user nova-compute[74701]:   <metadata>
Oct 20 13:46:10 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:46:10 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:46:10 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-server-838236975</nova:name>
Oct 20 13:46:10 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:46:08</nova:creationTime>
Oct 20 13:46:10 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:46:10 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:46:10 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:46:10 user nova-compute[74701]:       <nova:owner>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:46:10 user nova-compute[74701]:       </nova:owner>
Oct 20 13:46:10 user nova-compute[74701]:       <nova:ports>
Oct 20 13:46:10 user nova-compute[74701]:         <nova:port uuid="99c47a93-30f6-45b2-89d8-14e173610ec8">
Oct 20 13:46:10 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 13:46:10 user nova-compute[74701]:         </nova:port>
Oct 20 13:46:10 user nova-compute[74701]:       </nova:ports>
Oct 20 13:46:10 user nova-compute[74701]:     </nova:instance>
Oct 20 13:46:10 user nova-compute[74701]:   </metadata>
Oct 20 13:46:10 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:46:10 user nova-compute[74701]:     <system>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="serial">5b4f1195-f4db-414d-bd20-6f9393b98b7c</entry>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="uuid">5b4f1195-f4db-414d-bd20-6f9393b98b7c</entry>
Oct 20 13:46:10 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:46:10 user nova-compute[74701]:     </system>
Oct 20 13:46:10 user nova-compute[74701]:   </sysinfo>
Oct 20 13:46:10 user nova-compute[74701]:   <os>
Oct 20 13:46:10 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:46:10 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:46:10 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:46:10 user nova-compute[74701]:   </os>
Oct 20 13:46:10 user nova-compute[74701]:   <features>
Oct 20 13:46:10 user nova-compute[74701]:     <acpi/>
Oct 20 13:46:10 user nova-compute[74701]:     <apic/>
Oct 20 13:46:10 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:46:10 user nova-compute[74701]:   </features>
Oct 20 13:46:10 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:46:10 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:46:10 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:46:10 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:46:10 user nova-compute[74701]:   </clock>
Oct 20 13:46:10 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:46:10 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:46:10 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:46:10 user nova-compute[74701]:   </cpu>
Oct 20 13:46:10 user nova-compute[74701]:   <devices>
Oct 20 13:46:10 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:46:10 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:46:10 user nova-compute[74701]:       <source dev="/dev/sdc"/>
Oct 20 13:46:10 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:46:10 user nova-compute[74701]:       <serial>8fef76f8-6f2f-4fc7-afce-49b38bbbd529</serial>
Oct 20 13:46:10 user nova-compute[74701]:     </disk>
Oct 20 13:46:10 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:46:10 user nova-compute[74701]:       <mac address="fa:16:3e:c1:53:be"/>
Oct 20 13:46:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:46:10 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:46:10 user nova-compute[74701]:       <target dev="tap99c47a93-30"/>
Oct 20 13:46:10 user nova-compute[74701]:     </interface>
Oct 20 13:46:10 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:46:10 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/5b4f1195-f4db-414d-bd20-6f9393b98b7c/console.log" append="off"/>
Oct 20 13:46:10 user nova-compute[74701]:     </serial>
Oct 20 13:46:10 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:46:10 user nova-compute[74701]:     <video>
Oct 20 13:46:10 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:46:10 user nova-compute[74701]:     </video>
Oct 20 13:46:10 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:46:10 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:46:10 user nova-compute[74701]:     </rng>
Oct 20 13:46:10 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:46:10 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:46:10 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:46:10 user nova-compute[74701]:     </memballoon>
Oct 20 13:46:10 user nova-compute[74701]:   </devices>
Oct 20 13:46:10 user nova-compute[74701]: </domain>
Oct 20 13:46:10 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-838236975',display_name='tempest-TestVolumeBootPattern-server-838236975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-838236975',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-q1u061tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:45:52Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=5b4f1195-f4db-414d-bd20-6f9393b98b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG os_vif [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f7d27d9-fa05-546c-be92-14263a4d6342', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99c47a93-30, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99c47a93-30, col_values=(('qos', UUID('27777e1b-f74b-4f26-a1a4-9d45c800278b')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99c47a93-30, col_values=(('external_ids', {'iface-id': '99c47a93-30f6-45b2-89d8-14e173610ec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:53:be', 'vm-uuid': '5b4f1195-f4db-414d-bd20-6f9393b98b7c'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:10 user nova-compute[74701]: INFO os_vif [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30')
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:c1:53:be, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:10 user nova-compute[74701]: INFO nova.compute.manager [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Rebooting instance
Oct 20 13:46:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:46:10 user nova-compute[74701]: DEBUG nova.network.neutron [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.network.neutron [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.compute.manager [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:11 user nova-compute[74701]: WARNING nova.compute.manager [req-7065b50d-1cbb-4439-98d4-87cadefd3642 req-3f5a9732-8b64-4e9e-8833-1b2efc0af356 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:11 user nova-compute[74701]: DEBUG nova.compute.manager [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] No waiting events found dispatching network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:11 user nova-compute[74701]: WARNING nova.compute.manager [req-8db62d10-9faf-4556-95ef-ef735d1dc212 req-a4a22559-b00a-40f9-a9bb-e006f96e05aa service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received unexpected event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 for instance with vm_state building and task_state spawning.
Oct 20 13:46:12 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance destroyed successfully.
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'resources' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:46:11Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6a5abda-c6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=169eadcc-bd79-4fed-b692-fdc6cfb99af8) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:12 user nova-compute[74701]: INFO os_vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6')
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:46:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad68b79-56d0-4923-a37e-0758df79d71d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:46:12 user nova-compute[74701]: No targets found.
Oct 20 13:46:12 user nova-compute[74701]: iSNS:
Oct 20 13:46:12 user nova-compute[74701]: No targets found.
Oct 20 13:46:12 user nova-compute[74701]: STATIC:
Oct 20 13:46:12 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052
Oct 20 13:46:12 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:46:12 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:46:12 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529
Oct 20 13:46:12 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:46:12 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:46:12 user nova-compute[74701]: FIRMWARE:
Oct 20 13:46:12 user nova-compute[74701]: No targets found.
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:46:12 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:46:12 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d905af-a584-47f6-b0ca-5ee8f615f5ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd54a8c-e6be-4e75-a0ad-66cbecc30eaf]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e07ae320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d7ead3-0e16-492a-a9d0-885ce654b89c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbabb298-c047-4d4e-ad4f-718f05a94e3e]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c3f623-8ec5-4518-a006-b6c0899e74ab]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c20ea7-26bb-424a-960c-7bd5a64326ec]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4a7ad3-6d33-4b18-b32c-0e97158af165]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a346b0b-352b-4d97-99e7-07f4a4b24796]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]
Oct 20 13:46:12 user nova-compute[74701]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99575a3a-4eb4-47e6-8736-4874336ed8d6]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== disconnect_volume: return (297ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start _get_guest_xml network_info=[{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=739adbf0-3010-4fda-8848-c5d35e115e61,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '739adbf0-3010-4fda-8848-c5d35e115e61'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '145a0db7-fbd9-439f-a869-f76a2d41c9bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd560888d-30d7-4400-9c3f-7051f547a052', 'serial': 'd560888d-30d7-4400-9c3f-7051f547a052'}, 'attachment_id': 'd8a2fa81-1f73-4a7a-80ab-a20d1bba9da2', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:46:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:12 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=739adbf0-3010-4fda-8848-c5d35e115e61,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.objects.instance [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'vcpu_model' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.objects.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Object Instance<145a0db7-fbd9-439f-a869-f76a2d41c9bf> lazy-loaded attributes: resources,vcpu_model {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:46:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:46:12 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:46:12 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c832fc0f-7839-4b0d-bf3b-fdcf0b9824d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:46:12 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02d767d-b078-4ad1-96c3-2074f1245df3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052] added
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a48c26-816a-4de6-9a92-eefc8cd08caf]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1dc4f0-cfc3-4bfc-86b6-b30fd3ce01da]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlTbkdmD {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlTbkdmD" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[26953384-0095-46f9-89ca-9c680ac5c718]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlTbkdmD'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[045dc08f-4841-47f6-ae2a-42bd18ef1bb2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea3ffc-3635-4f20-8b15-050636f8e619]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a43762-a5ab-4c0f-abe7-d12f1af923de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]
Oct 20 13:46:12 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[151c03a5-1ef3-47ae-b4e5-aa11f33f0d54]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a1496c-3932-47aa-ae16-b1e3062f78cb]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:46:12 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ccdea-4597-449c-a0d8-7599cd9b34ae]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:46:12 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:13 user nova-compute[74701]: WARNING nova.compute.manager [req-b02bf565-7de4-4b71-94d5-290bc9ad69b6 req-b1ddbbf1-9030-4d8e-bc21-30b49a0ab636 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] No waiting events found dispatching network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:13 user nova-compute[74701]: WARNING nova.compute.manager [req-9bf4bfa5-3d6a-4986-93d9-6c3a4338a153 req-d7ccd190-2241-4970-87cd-0debd3c54eec service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received unexpected event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 for instance with vm_state building and task_state spawning.
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:46:13 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Instance spawned successfully.
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23661636165346134', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661636165346134', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:46:11Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.objects.instance [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'pci_devices' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.objects.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Object Instance<145a0db7-fbd9-439f-a869-f76a2d41c9bf> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:46:13 user nova-compute[74701]:   <uuid>145a0db7-fbd9-439f-a869-f76a2d41c9bf</uuid>
Oct 20 13:46:13 user nova-compute[74701]:   <name>instance-00000031</name>
Oct 20 13:46:13 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:46:13 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:46:13 user nova-compute[74701]:   <metadata>
Oct 20 13:46:13 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:46:13 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:name>tempest-TestMinimumBasicScenario-server-459358787</nova:name>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:46:12</nova:creationTime>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:46:13 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:46:13 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:owner>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:user uuid="66b5f73e271a42eab0d3733e60317550">tempest-TestMinimumBasicScenario-76758976-project-member</nova:user>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:project uuid="f04195d30b684d72b548c2d11dca2b43">tempest-TestMinimumBasicScenario-76758976</nova:project>
Oct 20 13:46:13 user nova-compute[74701]:       </nova:owner>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:root type="image" uuid="739adbf0-3010-4fda-8848-c5d35e115e61"/>
Oct 20 13:46:13 user nova-compute[74701]:       <nova:ports>
Oct 20 13:46:13 user nova-compute[74701]:         <nova:port uuid="d6a5abda-c679-4e7e-97f4-fe7fe45aac58">
Oct 20 13:46:13 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 13:46:13 user nova-compute[74701]:         </nova:port>
Oct 20 13:46:13 user nova-compute[74701]:       </nova:ports>
Oct 20 13:46:13 user nova-compute[74701]:     </nova:instance>
Oct 20 13:46:13 user nova-compute[74701]:   </metadata>
Oct 20 13:46:13 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:46:13 user nova-compute[74701]:     <system>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="serial">145a0db7-fbd9-439f-a869-f76a2d41c9bf</entry>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="uuid">145a0db7-fbd9-439f-a869-f76a2d41c9bf</entry>
Oct 20 13:46:13 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:46:13 user nova-compute[74701]:     </system>
Oct 20 13:46:13 user nova-compute[74701]:   </sysinfo>
Oct 20 13:46:13 user nova-compute[74701]:   <os>
Oct 20 13:46:13 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:46:13 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:46:13 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:46:13 user nova-compute[74701]:   </os>
Oct 20 13:46:13 user nova-compute[74701]:   <features>
Oct 20 13:46:13 user nova-compute[74701]:     <acpi/>
Oct 20 13:46:13 user nova-compute[74701]:     <apic/>
Oct 20 13:46:13 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:46:13 user nova-compute[74701]:   </features>
Oct 20 13:46:13 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:46:13 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:46:13 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:46:13 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:46:13 user nova-compute[74701]:   </clock>
Oct 20 13:46:13 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:46:13 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:46:13 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:46:13 user nova-compute[74701]:   </cpu>
Oct 20 13:46:13 user nova-compute[74701]:   <devices>
Oct 20 13:46:13 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:46:13 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:46:13 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk"/>
Oct 20 13:46:13 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:46:13 user nova-compute[74701]:     </disk>
Oct 20 13:46:13 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:46:13 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:46:13 user nova-compute[74701]:       <source dev="/dev/sdb"/>
Oct 20 13:46:13 user nova-compute[74701]:       <target dev="vdb" bus="virtio"/>
Oct 20 13:46:13 user nova-compute[74701]:       <serial>d560888d-30d7-4400-9c3f-7051f547a052</serial>
Oct 20 13:46:13 user nova-compute[74701]:     </disk>
Oct 20 13:46:13 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:46:13 user nova-compute[74701]:       <mac address="fa:16:3e:c3:74:8d"/>
Oct 20 13:46:13 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:46:13 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:46:13 user nova-compute[74701]:       <target dev="tapd6a5abda-c6"/>
Oct 20 13:46:13 user nova-compute[74701]:     </interface>
Oct 20 13:46:13 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:46:13 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/console.log" append="off"/>
Oct 20 13:46:13 user nova-compute[74701]:     </serial>
Oct 20 13:46:13 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:46:13 user nova-compute[74701]:     <video>
Oct 20 13:46:13 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:46:13 user nova-compute[74701]:     </video>
Oct 20 13:46:13 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:46:13 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:46:13 user nova-compute[74701]:     </rng>
Oct 20 13:46:13 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:46:13 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:46:13 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:46:13 user nova-compute[74701]:     </memballoon>
Oct 20 13:46:13 user nova-compute[74701]:   </devices>
Oct 20 13:46:13 user nova-compute[74701]: </domain>
Oct 20 13:46:13 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:46:13 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:13 user nova-compute[74701]: INFO nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 20 13:46:13 user nova-compute[74701]: DEBUG nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:46:13 user nova-compute[74701]: INFO nova.compute.manager [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Took 22.42 seconds to build instance.
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-d74bc457-93f2-4a9c-adb2-5ec40ba72c48 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.513s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'trusted_certs' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.objects.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Object Instance<145a0db7-fbd9-439f-a869-f76a2d41c9bf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a7564dd244f6e46f35c2162f66fb29babb67c1c --force-share --output=json" returned: 0 in 0.183s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Cannot resize image /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.objects.instance [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'migration_context' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.objects.base [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Object Instance<145a0db7-fbd9-439f-a869-f76a2d41c9bf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74701) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:46:11Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG os_vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad5fa02c-1623-5d9f-af6c-212443696937', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6a5abda-c6, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6a5abda-c6, col_values=(('qos', UUID('af19fa7a-54c2-40dc-9434-3587f4a317ce')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6a5abda-c6, col_values=(('external_ids', {'iface-id': 'd6a5abda-c679-4e7e-97f4-fe7fe45aac58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:74:8d', 'vm-uuid': '145a0db7-fbd9-439f-a869-f76a2d41c9bf'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:14 user nova-compute[74701]: INFO os_vif [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6')
Oct 20 13:46:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG nova.compute.manager [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:16 user nova-compute[74701]: WARNING nova.compute.manager [req-98044027-ca4d-416e-a76f-7b74ee06d340 req-b181a29c-c753-4b33-98e0-ca36f87d33f0 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 13:46:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:46:18 user nova-compute[74701]: WARNING nova.compute.manager [req-515b47ca-3437-4f43-9ceb-65d2e521ccb7 req-cebb2d15-6e8c-43a8-b97a-4992f4d3d646 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 13:46:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:46:18 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance rebooted successfully.
Oct 20 13:46:18 user nova-compute[74701]: DEBUG nova.compute.manager [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:46:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-477845d0-41b8-4f75-b179-1b32be64c2a1 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.836s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:46:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:24 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:24 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=24.90703582763672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:46:24 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:46:25 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:46:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:46:29 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:46:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:46:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:46:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:43 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:46:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:46:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:46:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:47:23 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:47:24 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:47:24 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.906192779541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:47:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:47:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:47:28 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:47:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:47:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:47:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:47:30 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:47:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:37 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:37 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:47:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG nova.compute.manager [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing instance network info cache due to event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG nova.network.neutron [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG nova.network.neutron [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updated VIF entry in instance network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG nova.network.neutron [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:47:43 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-45ead9d8-9215-41a8-aaac-bcf239b3d55b req-9e18b8cf-0e53-4a56-b715-e54ebd425bb5 service nova] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:47:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:47:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:47:58 user nova-compute[74701]: INFO nova.compute.claims [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Claim successful on node user
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:47:58 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG nova.policy [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5366854e8ec4ed3a35c5b1b289ecab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a3f132369e4dd4a0eb84377e1d158e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:47:58 user nova-compute[74701]: INFO nova.virt.block_device [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Booting with volume d6646e88-e4a1-4745-824d-5cfd5802b7b9 at /dev/vda
Oct 20 13:47:58 user nova-compute[74701]: DEBUG os_brick.utils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e64fcf-efe2-40a3-a249-58889b5a1eba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25efa18-eda2-492e-ba43-013a3d577d1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9a94e-bd6d-4df3-a1d6-abb681a2b7d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd32397-6b87-412b-aeeb-edd5c5d52916]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:47:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:47:59 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:47:59 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[75336154-e920-4240-91ae-292ad47ce39c]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG os_brick.utils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating existing volume attachment record: 567f53a2-78df-4a97-b865-50469f8e20a3 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Successfully created port: e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:47:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Successfully updated port: e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquired lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-changed-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.compute.manager [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing instance network info cache due to event network-changed-e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] Acquiring lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.network.neutron [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Releasing lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Instance network_info: |[{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] Acquired lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:48:00 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing network info cache for port e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:48:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updated VIF entry in instance network info cache for port e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:48:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:48:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-5ee8ae6f-be18-4426-abab-66ae87bce1d5 req-674b466e-0151-4c0d-bec4-a21a1415db00 service nova] Releasing lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing instance network info cache due to event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:48:02 user nova-compute[74701]: DEBUG nova.network.neutron [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated VIF entry in instance network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-65342ad2-852b-4754-a1ca-55640f77a37f req-aca2d7f2-565c-4f55-b7ed-96c3af814862 service nova] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing instance network info cache due to event network-changed-d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG nova.network.neutron [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Refreshing network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:04 user nova-compute[74701]: INFO nova.compute.manager [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Detaching volume d560888d-30d7-4400-9c3f-7051f547a052
Oct 20 13:48:04 user nova-compute[74701]: INFO nova.virt.block_device [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Attempting to driver detach volume d560888d-30d7-4400-9c3f-7051f547a052 from mountpoint /dev/vdb
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated VIF entry in instance network info cache for port d6a5abda-c679-4e7e-97f4-fe7fe45aac58. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.network.neutron [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Attempting to detach device vdb from instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:48:04 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:48:04 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:48:04 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:48:04 user nova-compute[74701]:   <serial>d560888d-30d7-4400-9c3f-7051f547a052</serial>
Oct 20 13:48:04 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:48:04 user nova-compute[74701]: </disk>
Oct 20 13:48:04 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-873e6cea-052c-4870-87bf-522d7c192119 req-395e2882-133a-4067-82af-c4fd30fbf91d service nova] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:48:04 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully detached device vdb from instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf from the persistent domain config.
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:48:04 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:48:04 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:48:04 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:48:04 user nova-compute[74701]:   <serial>d560888d-30d7-4400-9c3f-7051f547a052</serial>
Oct 20 13:48:04 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 13:48:04 user nova-compute[74701]: </disk>
Oct 20 13:48:04 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:48:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:48:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:48:15 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Creating image(s)
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Did not create local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Ensure instance console log exists: /opt/stack/data/nova/instances/50c3b202-683c-4ee2-85f7-303c18da51bf/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Start _get_guest_xml network_info=[{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TADEGyaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50c3b202-683c-4ee2-85f7-303c18da51bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6646e88-e4a1-4745-824d-5cfd5802b7b9', 'serial': 'd6646e88-e4a1-4745-824d-5cfd5802b7b9'}, 'attachment_id': '567f53a2-78df-4a97-b865-50469f8e20a3', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:48:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:48:15 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TADEGyaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:48:15 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:48:15 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:48:15 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3669afc7-819d-4ccd-a74f-c0d8d72f55ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:48:15 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2ef60-f746-4337-819b-3d740c8ce1a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9] added
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[de12aa33-fbff-4fc0-af22-11c1d0bc83b5]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa8706a-678d-4757-b3f3-813209ebd6c2]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TADEGyaW {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TADEGyaW" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69343536-8a18-49e8-9a63-acc78bc7ef6c]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TADEGyaW'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8104bf85-4d35-463f-b10a-ad4838a92874]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeee81a-57c4-435b-a565-b22bb16d8bfd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[971f71dc-e752-4268-a1f7-0c2e72bd4bec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260]
Oct 20 13:48:15 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260] successful.
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f31fb5-d71d-4ae9-a594-456da94b0091]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1e3110-4e6e-426c-a936-b48df60dbfb9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:48:15 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9424f6e-b08c-4fe0-9c2c-375a28d64109]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:15 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TADEGyaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26630366364653166', 'path': '/dev/sdd'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630366364653166', 'path': '/dev/sdd'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531026687',display_name='tempest-TestVolumeBootPattern-server-1531026687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531026687',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-au0efqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:47:59Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=50c3b202-683c-4ee2-85f7-303c18da51bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.objects.instance [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'pci_devices' on Instance uuid 50c3b202-683c-4ee2-85f7-303c18da51bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:48:16 user nova-compute[74701]:   <uuid>50c3b202-683c-4ee2-85f7-303c18da51bf</uuid>
Oct 20 13:48:16 user nova-compute[74701]:   <name>instance-00000033</name>
Oct 20 13:48:16 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:48:16 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:48:16 user nova-compute[74701]:   <metadata>
Oct 20 13:48:16 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:48:16 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:48:16 user nova-compute[74701]:       <nova:name>tempest-TestVolumeBootPattern-server-1531026687</nova:name>
Oct 20 13:48:16 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:48:15</nova:creationTime>
Oct 20 13:48:16 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:48:16 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:48:16 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:48:16 user nova-compute[74701]:       <nova:owner>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:user uuid="e5366854e8ec4ed3a35c5b1b289ecab0">tempest-TestVolumeBootPattern-1725340178-project-member</nova:user>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:project uuid="a8a3f132369e4dd4a0eb84377e1d158e">tempest-TestVolumeBootPattern-1725340178</nova:project>
Oct 20 13:48:16 user nova-compute[74701]:       </nova:owner>
Oct 20 13:48:16 user nova-compute[74701]:       <nova:ports>
Oct 20 13:48:16 user nova-compute[74701]:         <nova:port uuid="e76867c8-8dee-45ce-93ef-875c20728055">
Oct 20 13:48:16 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 13:48:16 user nova-compute[74701]:         </nova:port>
Oct 20 13:48:16 user nova-compute[74701]:       </nova:ports>
Oct 20 13:48:16 user nova-compute[74701]:     </nova:instance>
Oct 20 13:48:16 user nova-compute[74701]:   </metadata>
Oct 20 13:48:16 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:48:16 user nova-compute[74701]:     <system>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="serial">50c3b202-683c-4ee2-85f7-303c18da51bf</entry>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="uuid">50c3b202-683c-4ee2-85f7-303c18da51bf</entry>
Oct 20 13:48:16 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:48:16 user nova-compute[74701]:     </system>
Oct 20 13:48:16 user nova-compute[74701]:   </sysinfo>
Oct 20 13:48:16 user nova-compute[74701]:   <os>
Oct 20 13:48:16 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:48:16 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:48:16 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:48:16 user nova-compute[74701]:   </os>
Oct 20 13:48:16 user nova-compute[74701]:   <features>
Oct 20 13:48:16 user nova-compute[74701]:     <acpi/>
Oct 20 13:48:16 user nova-compute[74701]:     <apic/>
Oct 20 13:48:16 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:48:16 user nova-compute[74701]:   </features>
Oct 20 13:48:16 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:48:16 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:48:16 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:48:16 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:48:16 user nova-compute[74701]:   </clock>
Oct 20 13:48:16 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:48:16 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:48:16 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:48:16 user nova-compute[74701]:   </cpu>
Oct 20 13:48:16 user nova-compute[74701]:   <devices>
Oct 20 13:48:16 user nova-compute[74701]:     <disk type="block" device="disk">
Oct 20 13:48:16 user nova-compute[74701]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:48:16 user nova-compute[74701]:       <source dev="/dev/sdd"/>
Oct 20 13:48:16 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:48:16 user nova-compute[74701]:       <serial>d6646e88-e4a1-4745-824d-5cfd5802b7b9</serial>
Oct 20 13:48:16 user nova-compute[74701]:     </disk>
Oct 20 13:48:16 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:48:16 user nova-compute[74701]:       <mac address="fa:16:3e:8c:fd:b8"/>
Oct 20 13:48:16 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:48:16 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:48:16 user nova-compute[74701]:       <target dev="tape76867c8-8d"/>
Oct 20 13:48:16 user nova-compute[74701]:     </interface>
Oct 20 13:48:16 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:48:16 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/50c3b202-683c-4ee2-85f7-303c18da51bf/console.log" append="off"/>
Oct 20 13:48:16 user nova-compute[74701]:     </serial>
Oct 20 13:48:16 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:48:16 user nova-compute[74701]:     <video>
Oct 20 13:48:16 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:48:16 user nova-compute[74701]:     </video>
Oct 20 13:48:16 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:48:16 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:48:16 user nova-compute[74701]:     </rng>
Oct 20 13:48:16 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:48:16 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:48:16 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:48:16 user nova-compute[74701]:     </memballoon>
Oct 20 13:48:16 user nova-compute[74701]:   </devices>
Oct 20 13:48:16 user nova-compute[74701]: </domain>
Oct 20 13:48:16 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531026687',display_name='tempest-TestVolumeBootPattern-server-1531026687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531026687',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-au0efqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:47:59Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=50c3b202-683c-4ee2-85f7-303c18da51bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG os_vif [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a862f94-c648-5aaa-86a4-5176fac88843', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape76867c8-8d, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape76867c8-8d, col_values=(('qos', UUID('bde37775-b560-416f-b019-cb25886dfec5')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape76867c8-8d, col_values=(('external_ids', {'iface-id': 'e76867c8-8dee-45ce-93ef-875c20728055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:fd:b8', 'vm-uuid': '50c3b202-683c-4ee2-85f7-303c18da51bf'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:16 user nova-compute[74701]: INFO os_vif [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d')
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:48:16 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] No VIF found with MAC fa:16:3e:8c:fd:b8, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:48:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:18 user nova-compute[74701]: DEBUG nova.compute.manager [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] No waiting events found dispatching network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:48:18 user nova-compute[74701]: WARNING nova.compute.manager [req-a0612839-9a3b-47ad-92d9-f48df0311cff req-570d8dcd-d70c-4657-8a41-665708a4e0b2 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received unexpected event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 for instance with vm_state building and task_state spawning.
Oct 20 13:48:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:48:20 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Instance spawned successfully.
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:48:20 user nova-compute[74701]: INFO nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Took 4.95 seconds to spawn the instance on the hypervisor.
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:20 user nova-compute[74701]: DEBUG nova.compute.manager [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] No waiting events found dispatching network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:48:20 user nova-compute[74701]: WARNING nova.compute.manager [req-090ac871-9656-421f-b130-74a480c16d3d req-1ffdf349-adcb-4a8b-ac6c-215b2fd6bdfa service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received unexpected event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 for instance with vm_state active and task_state None.
Oct 20 13:48:20 user nova-compute[74701]: INFO nova.compute.manager [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Took 21.95 seconds to build instance.
Oct 20 13:48:20 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-754c17f0-df00-4da2-804f-d6d55cb1e991 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.042s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:21 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:24 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf is timed out.
Oct 20 13:48:24 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully detached device vdb from instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf from the live domain config.
Oct 20 13:48:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlTbkdmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:48:24 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c48ee8-72dd-4b46-aa61-867952927ddd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:48:24 user nova-compute[74701]: No targets found.
Oct 20 13:48:24 user nova-compute[74701]: iSNS:
Oct 20 13:48:24 user nova-compute[74701]: No targets found.
Oct 20 13:48:24 user nova-compute[74701]: STATIC:
Oct 20 13:48:24 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052
Oct 20 13:48:24 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:48:24 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:48:24 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529
Oct 20 13:48:24 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:48:24 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:48:24 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9
Oct 20 13:48:24 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:48:24 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:48:24 user nova-compute[74701]: FIRMWARE:
Oct 20 13:48:24 user nova-compute[74701]: No targets found.
Oct 20 13:48:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:48:24 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:48:24 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf3e9d-e981-45d4-8022-c73dea1eebd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[18921b41-5b80-4e10-8359-011029cf1a7d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:48:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e01c4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c4f41d-c2fe-4d61-bf83-817154438a66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4cc074-eaf4-4662-aba3-d2eec5de3bd9]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7b0a1-a72d-4360-9836-8462b33997b8]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[35164a34-70f6-48b7-85b6-0e40aa1ddab7]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541916f-c698-4594-a2e5-752b4b730409]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480a8f9-d208-41f6-bacb-a8eb85affa3c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260]
Oct 20 13:48:24 user nova-compute[74701]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052, portal: 172.16.0.220,3260] successful.
Oct 20 13:48:24 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d560888d-30d7-4400-9c3f-7051f547a052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7aabe6-e479-4b65-9599-8428ef4e4ffb]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== disconnect_volume: return (308ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:48:24 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG nova.objects.instance [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-ef36b8f4-ea54-4cc6-8b29-ab763abf02af tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:48:26 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:48:26 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=24.89636993408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 50c3b202-683c-4ee2-85f7-303c18da51bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:48:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:48:27 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:48:27 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:48:27 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:48:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:48:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:48:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:48:31 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:48:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [{"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:48:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-145a0db7-fbd9-439f-a869-f76a2d41c9bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:48:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:48:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:36 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:37 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:39 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:39 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:48:41 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:48:46 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:48:56 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:03 user nova-compute[74701]: INFO nova.compute.manager [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Terminating instance
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-6d8bb9e8-ae9e-4488-96c0-4bc37a91de6e req-390a77ee-e26d-4523-bbad-c4aff0405292 service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-unplugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Instance destroyed successfully.
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.objects.instance [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'resources' on Instance uuid 145a0db7-fbd9-439f-a869-f76a2d41c9bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-459358787',display_name='tempest-TestMinimumBasicScenario-server-459358787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-459358787',id=49,image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqasv0+5csEqW3NnoIH3YrW29vDgXkJqIXnyWkmsoxGOKt8G3XtOEWrqKraPkkb6cApDTlEMtg8swrPdG5IpVDF7NJoxDiKYao5oIponEdy//zoiWLzQyeXrQ0Ih6ICaA==',key_name='tempest-TestMinimumBasicScenario-1144982486',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-j8z9727r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='739adbf0-3010-4fda-8848-c5d35e115e61',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:46:18Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=145a0db7-fbd9-439f-a869-f76a2d41c9bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "address": "fa:16:3e:c3:74:8d", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a5abda-c6", "ovs_interfaceid": "d6a5abda-c679-4e7e-97f4-fe7fe45aac58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG os_vif [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6a5abda-c6, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af19fa7a-54c2-40dc-9434-3587f4a317ce) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:03 user nova-compute[74701]: INFO os_vif [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:74:8d,bridge_name='br-int',has_traffic_filtering=True,id=d6a5abda-c679-4e7e-97f4-fe7fe45aac58,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a5abda-c6')
Oct 20 13:49:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Deleting instance files /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf_del
Oct 20 13:49:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Deletion of /opt/stack/data/nova/instances/145a0db7-fbd9-439f-a869-f76a2d41c9bf_del complete
Oct 20 13:49:04 user nova-compute[74701]: INFO nova.compute.manager [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 13:49:04 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:04 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Took 0.53 seconds to deallocate network for instance.
Oct 20 13:49:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:49:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:04 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Deleted allocations for instance 145a0db7-fbd9-439f-a869-f76a2d41c9bf
Oct 20 13:49:04 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-4185cbaa-db08-4298-9c00-cbb1c12e90a4 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.786s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] Acquiring lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:05 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] Lock "145a0db7-fbd9-439f-a869-f76a2d41c9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] No waiting events found dispatching network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:49:05 user nova-compute[74701]: WARNING nova.compute.manager [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received unexpected event network-vif-plugged-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 for instance with vm_state deleted and task_state None.
Oct 20 13:49:05 user nova-compute[74701]: DEBUG nova.compute.manager [req-34a30935-f78b-42d8-b0f3-d77307b1df2d req-dc1b5e93-ccad-4178-a0d0-2a0f6950affc service nova] [instance: 145a0db7-fbd9-439f-a869-f76a2d41c9bf] Received event network-vif-deleted-d6a5abda-c679-4e7e-97f4-fe7fe45aac58 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:08 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:18 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:23 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:49:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:49:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:49:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=24.923568725585938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 50c3b202-683c-4ee2-85f7-303c18da51bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:49:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:28 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:49:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:49:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:49:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:49:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:49:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:49:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:33 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:49:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:40 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:40 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:49:43 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:49:48 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-changed-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG nova.compute.manager [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing instance network info cache due to event network-changed-e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] Acquiring lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] Acquired lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing network info cache for port e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updated VIF entry in instance network info cache for port e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG nova.network.neutron [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:50 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-003c7848-ced1-4606-b0d1-fc4baffdf3d2 req-5421eb60-0041-412e-a00f-d7c16a723562 service nova] Releasing lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-changed-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.compute.manager [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing instance network info cache due to event network-changed-e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] Acquiring lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] Acquired lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Refreshing network info cache for port e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:51 user nova-compute[74701]: INFO nova.compute.manager [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Terminating instance
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.compute.manager [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updated VIF entry in instance network info cache for port e76867c8-8dee-45ce-93ef-875c20728055. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG nova.network.neutron [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [{"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-03ca6765-5ca5-4bc4-a1f9-b5c69982ffa8 req-6e51ae81-10fc-43e1-820f-a50500976836 service nova] Releasing lock "refresh_cache-50c3b202-683c-4ee2-85f7-303c18da51bf" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:51 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Instance destroyed successfully.
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid 50c3b202-683c-4ee2-85f7-303c18da51bf {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1531026687',display_name='tempest-TestVolumeBootPattern-server-1531026687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1531026687',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-au0efqkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:48:20Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=50c3b202-683c-4ee2-85f7-303c18da51bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "e76867c8-8dee-45ce-93ef-875c20728055", "address": "fa:16:3e:8c:fd:b8", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76867c8-8d", "ovs_interfaceid": "e76867c8-8dee-45ce-93ef-875c20728055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_vif [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape76867c8-8d, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bde37775-b560-416f-b019-cb25886dfec5) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:52 user nova-compute[74701]: INFO os_vif [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=e76867c8-8dee-45ce-93ef-875c20728055,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76867c8-8d')
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TADEGyaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:49:52 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fad182f-2392-4062-9217-e81c183f24b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:49:52 user nova-compute[74701]: No targets found.
Oct 20 13:49:52 user nova-compute[74701]: iSNS:
Oct 20 13:49:52 user nova-compute[74701]: No targets found.
Oct 20 13:49:52 user nova-compute[74701]: STATIC:
Oct 20 13:49:52 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529
Oct 20 13:49:52 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:49:52 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:49:52 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9
Oct 20 13:49:52 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:49:52 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:49:52 user nova-compute[74701]: FIRMWARE:
Oct 20 13:49:52 user nova-compute[74701]: No targets found.
Oct 20 13:49:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:49:52 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:49:52 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a06af-233d-4ec6-9236-2c5b28ae1cf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3bfc7-f009-4729-afd7-8746224ae920]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:49:52 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:49:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:49:52 user nova-compute[74701]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 (non-flash)
Oct 20 13:49:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e01c7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9'): ({'sdd'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdd {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e1795-5012-4f6b-b81f-6676da9d5b33]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a09f2b-c02f-4d7c-bf70-c71bef123942]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdd {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e37d74-555b-4faa-b763-dc779d5d963f]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cc4d53-dd42-4d22-8a5e-6090953f5662]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdd have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_58571901',) {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b4c5a-93dc-4ab3-a0f0-7f5d3b82c8cb]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-unplugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] No waiting events found dispatching network-vif-unplugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-unplugged-e76867c8-8dee-45ce-93ef-875c20728055 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Acquiring lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] No waiting events found dispatching network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:49:52 user nova-compute[74701]: WARNING nova.compute.manager [req-26e4bef0-925e-49b7-aff4-3ac2c27eebba req-e21ff207-a095-4d61-a8e9-222c6b8282d5 service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received unexpected event network-vif-plugged-e76867c8-8dee-45ce-93ef-875c20728055 for instance with vm_state active and task_state deleting.
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[970af27e-335e-42b2-92ae-45e4ca714e82]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa7026-9e52-43f1-bf45-40e6f3f886af]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260]
Oct 20 13:49:52 user nova-compute[74701]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9, portal: 172.16.0.220,3260] successful.
Oct 20 13:49:52 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6646e88-e4a1-4745-824d-5cfd5802b7b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c2ac6b-5702-4b88-8fed-ffbcb25b07ce]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (305ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:49:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Deleting instance files /opt/stack/data/nova/instances/50c3b202-683c-4ee2-85f7-303c18da51bf_del
Oct 20 13:49:52 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Deletion of /opt/stack/data/nova/instances/50c3b202-683c-4ee2-85f7-303c18da51bf_del complete
Oct 20 13:49:52 user nova-compute[74701]: INFO nova.compute.manager [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 13:49:52 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:49:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:53 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:53 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Took 0.84 seconds to deallocate network for instance.
Oct 20 13:49:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-5daa101c-a0fc-40c2-87b6-5d7f512fca60 req-dc1ae5ee-d864-4018-99e4-b86c34031a8b service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Received event network-vif-deleted-e76867c8-8dee-45ce-93ef-875c20728055 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:53 user nova-compute[74701]: INFO nova.compute.manager [req-5daa101c-a0fc-40c2-87b6-5d7f512fca60 req-dc1ae5ee-d864-4018-99e4-b86c34031a8b service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Neutron deleted interface e76867c8-8dee-45ce-93ef-875c20728055; detaching it from the instance and deleting it from the info cache
Oct 20 13:49:53 user nova-compute[74701]: DEBUG nova.network.neutron [req-5daa101c-a0fc-40c2-87b6-5d7f512fca60 req-dc1ae5ee-d864-4018-99e4-b86c34031a8b service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:53 user nova-compute[74701]: DEBUG nova.compute.manager [req-5daa101c-a0fc-40c2-87b6-5d7f512fca60 req-dc1ae5ee-d864-4018-99e4-b86c34031a8b service nova] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Detach interface failed, port_id=e76867c8-8dee-45ce-93ef-875c20728055, reason: Instance 50c3b202-683c-4ee2-85f7-303c18da51bf could not be found. {{(pid=74701) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 13:49:54 user nova-compute[74701]: INFO nova.compute.manager [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 50c3b202-683c-4ee2-85f7-303c18da51bf] Took 0.82 seconds to detach 1 volumes for instance.
Oct 20 13:49:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:54 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:49:54 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:49:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:54 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance 50c3b202-683c-4ee2-85f7-303c18da51bf
Oct 20 13:49:54 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-688ba386-76c4-4f90-9032-4164053e83f2 tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "50c3b202-683c-4ee2-85f7-303c18da51bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:56 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:56 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Starting instance... {{(pid=74701) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74701) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 13:49:57 user nova-compute[74701]: INFO nova.compute.claims [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Claim successful on node user
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Start building networks asynchronously for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Allocating IP information in the background. {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] allocate_for_instance() {{(pid=74701) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 13:49:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Start building block device mappings for instance. {{(pid=74701) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.policy [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66b5f73e271a42eab0d3733e60317550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04195d30b684d72b548c2d11dca2b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74701) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Start spawning the instance on the hypervisor. {{(pid=74701) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Creating instance directory {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 13:49:57 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Creating image(s)
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "/opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "/opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:57 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.part --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Successfully created port: dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.virt.images [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb was qcow2, converting to raw {{(pid=74701) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.privsep.utils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74701) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.part /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.converted {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.part /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.converted" returned: 0 in 0.246s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.converted --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.991s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Successfully updated port: dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.compute.manager [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing instance network info cache due to event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance cache missing network info. {{(pid=74701) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:58 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6,backing_fmt=raw /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk 1073741824 {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.neutron [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6,backing_fmt=raw /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk 1073741824" returned: 0 in 0.254s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "e2404e3e433621b2e5a7409eb1b3156dd6e702d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance network_info: |[{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74701) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2404e3e433621b2e5a7409eb1b3156dd6e702d6 --force-share --output=json" returned: 0 in 0.355s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk. size=1073741824 {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.disk.api [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Cannot resize image /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk to a smaller size. {{(pid=74701) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Created local disks {{(pid=74701) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Ensure instance console log exists: /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/console.log {{(pid=74701) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Start _get_guest_xml network_info=[{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:49:54Z,direct_url=<?>,disk_format='qcow2',id=d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb,min_disk=0,min_ram=0,name='tempest-scenario-img--404369348',owner='f04195d30b684d72b548c2d11dca2b43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:49:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': 'd5dc7d11-d61e-405c-82fc-3b0c9d16ebfb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 13:49:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:49:59 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller missing on host. {{(pid=74701) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.host [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU controller found on host. {{(pid=74701) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74701) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T13:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T13:49:54Z,direct_url=<?>,disk_format='qcow2',id=d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb,min_disk=0,min_ram=0,name='tempest-scenario-img--404369348',owner='f04195d30b684d72b548c2d11dca2b43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T13:49:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image limits 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flavor pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Image pref 0:0:0 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Got 1 possible topologies {{(pid=74701) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.hardware [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74701) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-860528841',display_name='tempest-TestMinimumBasicScenario-server-860528841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-860528841',id=52,image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLLNCO9eLFf8i0SgJM2eWjSmUP4cid1rRr7HvIE7UNzourwyE/BbUlww6lk2Kzmrdhg/umOLHgk/zbRI8gG0xepc9SDS3MET4INIdjZ17zYrZfLEoBNel57FNbRLEBwoQ==',key_name='tempest-TestMinimumBasicScenario-1613711523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-weuaepf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:49:57Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=4c394f0f-9e62-45c7-9f31-bd274e497952,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74701) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.objects.instance [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] End _get_guest_xml xml=<domain type="kvm">
Oct 20 13:49:59 user nova-compute[74701]:   <uuid>4c394f0f-9e62-45c7-9f31-bd274e497952</uuid>
Oct 20 13:49:59 user nova-compute[74701]:   <name>instance-00000034</name>
Oct 20 13:49:59 user nova-compute[74701]:   <memory>524288</memory>
Oct 20 13:49:59 user nova-compute[74701]:   <vcpu>1</vcpu>
Oct 20 13:49:59 user nova-compute[74701]:   <metadata>
Oct 20 13:49:59 user nova-compute[74701]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 13:49:59 user nova-compute[74701]:       <nova:package version="0.0.0"/>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:name>tempest-TestMinimumBasicScenario-server-860528841</nova:name>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:creationTime>2023-10-20 13:49:59</nova:creationTime>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:flavor name="m1.tiny">
Oct 20 13:49:59 user nova-compute[74701]:         <nova:memory>512</nova:memory>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:disk>1</nova:disk>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:swap>0</nova:swap>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:vcpus>1</nova:vcpus>
Oct 20 13:49:59 user nova-compute[74701]:       </nova:flavor>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:owner>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:user uuid="66b5f73e271a42eab0d3733e60317550">tempest-TestMinimumBasicScenario-76758976-project-member</nova:user>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:project uuid="f04195d30b684d72b548c2d11dca2b43">tempest-TestMinimumBasicScenario-76758976</nova:project>
Oct 20 13:49:59 user nova-compute[74701]:       </nova:owner>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:root type="image" uuid="d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb"/>
Oct 20 13:49:59 user nova-compute[74701]:       <nova:ports>
Oct 20 13:49:59 user nova-compute[74701]:         <nova:port uuid="dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6">
Oct 20 13:49:59 user nova-compute[74701]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 13:49:59 user nova-compute[74701]:         </nova:port>
Oct 20 13:49:59 user nova-compute[74701]:       </nova:ports>
Oct 20 13:49:59 user nova-compute[74701]:     </nova:instance>
Oct 20 13:49:59 user nova-compute[74701]:   </metadata>
Oct 20 13:49:59 user nova-compute[74701]:   <sysinfo type="smbios">
Oct 20 13:49:59 user nova-compute[74701]:     <system>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="product">OpenStack Nova</entry>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="version">0.0.0</entry>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="serial">4c394f0f-9e62-45c7-9f31-bd274e497952</entry>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="uuid">4c394f0f-9e62-45c7-9f31-bd274e497952</entry>
Oct 20 13:49:59 user nova-compute[74701]:       <entry name="family">Virtual Machine</entry>
Oct 20 13:49:59 user nova-compute[74701]:     </system>
Oct 20 13:49:59 user nova-compute[74701]:   </sysinfo>
Oct 20 13:49:59 user nova-compute[74701]:   <os>
Oct 20 13:49:59 user nova-compute[74701]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 13:49:59 user nova-compute[74701]:     <boot dev="hd"/>
Oct 20 13:49:59 user nova-compute[74701]:     <smbios mode="sysinfo"/>
Oct 20 13:49:59 user nova-compute[74701]:   </os>
Oct 20 13:49:59 user nova-compute[74701]:   <features>
Oct 20 13:49:59 user nova-compute[74701]:     <acpi/>
Oct 20 13:49:59 user nova-compute[74701]:     <apic/>
Oct 20 13:49:59 user nova-compute[74701]:     <vmcoreinfo/>
Oct 20 13:49:59 user nova-compute[74701]:   </features>
Oct 20 13:49:59 user nova-compute[74701]:   <clock offset="utc">
Oct 20 13:49:59 user nova-compute[74701]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 13:49:59 user nova-compute[74701]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 13:49:59 user nova-compute[74701]:     <timer name="hpet" present="no"/>
Oct 20 13:49:59 user nova-compute[74701]:   </clock>
Oct 20 13:49:59 user nova-compute[74701]:   <cpu mode="custom" match="exact">
Oct 20 13:49:59 user nova-compute[74701]:     <model>Nehalem</model>
Oct 20 13:49:59 user nova-compute[74701]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 13:49:59 user nova-compute[74701]:   </cpu>
Oct 20 13:49:59 user nova-compute[74701]:   <devices>
Oct 20 13:49:59 user nova-compute[74701]:     <disk type="file" device="disk">
Oct 20 13:49:59 user nova-compute[74701]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 13:49:59 user nova-compute[74701]:       <source file="/opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk"/>
Oct 20 13:49:59 user nova-compute[74701]:       <target dev="vda" bus="virtio"/>
Oct 20 13:49:59 user nova-compute[74701]:     </disk>
Oct 20 13:49:59 user nova-compute[74701]:     <interface type="ethernet">
Oct 20 13:49:59 user nova-compute[74701]:       <mac address="fa:16:3e:5e:d2:4a"/>
Oct 20 13:49:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:49:59 user nova-compute[74701]:       <mtu size="1442"/>
Oct 20 13:49:59 user nova-compute[74701]:       <target dev="tapdc3b5d81-33"/>
Oct 20 13:49:59 user nova-compute[74701]:     </interface>
Oct 20 13:49:59 user nova-compute[74701]:     <serial type="pty">
Oct 20 13:49:59 user nova-compute[74701]:       <log file="/opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/console.log" append="off"/>
Oct 20 13:49:59 user nova-compute[74701]:     </serial>
Oct 20 13:49:59 user nova-compute[74701]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 13:49:59 user nova-compute[74701]:     <video>
Oct 20 13:49:59 user nova-compute[74701]:       <model type="virtio"/>
Oct 20 13:49:59 user nova-compute[74701]:     </video>
Oct 20 13:49:59 user nova-compute[74701]:     <rng model="virtio">
Oct 20 13:49:59 user nova-compute[74701]:       <backend model="random">/dev/urandom</backend>
Oct 20 13:49:59 user nova-compute[74701]:     </rng>
Oct 20 13:49:59 user nova-compute[74701]:     <controller type="usb" index="0" model="none"/>
Oct 20 13:49:59 user nova-compute[74701]:     <memballoon model="virtio">
Oct 20 13:49:59 user nova-compute[74701]:       <stats period="10"/>
Oct 20 13:49:59 user nova-compute[74701]:     </memballoon>
Oct 20 13:49:59 user nova-compute[74701]:   </devices>
Oct 20 13:49:59 user nova-compute[74701]: </domain>
Oct 20 13:49:59 user nova-compute[74701]:  {{(pid=74701) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-860528841',display_name='tempest-TestMinimumBasicScenario-server-860528841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-860528841',id=52,image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLLNCO9eLFf8i0SgJM2eWjSmUP4cid1rRr7HvIE7UNzourwyE/BbUlww6lk2Kzmrdhg/umOLHgk/zbRI8gG0xepc9SDS3MET4INIdjZ17zYrZfLEoBNel57FNbRLEBwoQ==',key_name='tempest-TestMinimumBasicScenario-1613711523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-weuaepf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T13:49:57Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=4c394f0f-9e62-45c7-9f31-bd274e497952,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG os_vif [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33') {{(pid=74701) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '861d26c3-647c-54de-b7dd-17bd68886249', '_type': 'linux-noop'}}, row=False) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc3b5d81-33, may_exist=True, interface_attrs={}) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc3b5d81-33, col_values=(('qos', UUID('787c92ef-7e49-4f21-9edc-3aabd15bacac')),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc3b5d81-33, col_values=(('external_ids', {'iface-id': 'dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d2:4a', 'vm-uuid': '4c394f0f-9e62-45c7-9f31-bd274e497952'}),), if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:49:59 user nova-compute[74701]: INFO os_vif [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33')
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No VIF found with MAC fa:16:3e:5e:d2:4a, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated VIF entry in instance network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG nova.network.neutron [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:49:59 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4f84dc4a-3016-4a9b-813e-0360f5a02dae req-adc30470-3917-4f25-89d0-9ce5c7dc4209 service nova] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:50:01 user nova-compute[74701]: WARNING nova.compute.manager [req-566a8fbc-127e-4e85-a42f-0582d963a45a req-6c140ec7-88d2-41bb-bad9-bf581445b1a9 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state building and task_state spawning.
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance event wait completed in 0 seconds for  {{(pid=74701) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Guest created on hypervisor {{(pid=74701) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 13:50:03 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance spawned successfully.
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_cdrom_bus of ide {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_disk_bus of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_input_bus of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_pointer_model of None {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_video_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Found default for hw_vif_model of virtio {{(pid=74701) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 13:50:03 user nova-compute[74701]: INFO nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:50:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:50:03 user nova-compute[74701]: WARNING nova.compute.manager [req-f7ff2061-d5f3-4b83-b5ca-26626b195f1c req-af716400-3c58-4c5b-bd81-ea2c0e927ae7 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state building and task_state spawning.
Oct 20 13:50:03 user nova-compute[74701]: INFO nova.compute.manager [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Took 6.49 seconds to build instance.
Oct 20 13:50:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-91923480-fb97-4840-8435-4552771f64b2 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:50:04 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:09 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:14 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:50:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:19 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:50:26 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:50:27 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.872894287109375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c394f0f-9e62-45c7-9f31-bd274e497952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:50:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:50:29 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:31 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:50:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:50:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:34 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:39 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:40 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:40 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:41 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:50:43 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:50:44 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:50:49 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:50:54 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:50:59 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing instance network info cache due to event network-changed-99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] Acquiring lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] Acquired lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Refreshing network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:01 user nova-compute[74701]: INFO nova.compute.manager [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Terminating instance
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updated VIF entry in instance network info cache for port 99c47a93-30f6-45b2-89d8-14e173610ec8. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.network.neutron [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [{"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-85ca8fe4-4d7b-49fb-af5a-7006268f7d54 req-299dbd0a-05cd-4ee2-b679-2ee894650e9f service nova] Releasing lock "refresh_cache-5b4f1195-f4db-414d-bd20-6f9393b98b7c" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-unplugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] No waiting events found dispatching network-vif-unplugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG nova.compute.manager [req-226ebeec-e569-40aa-963b-1d65f241eef0 req-af3f80a5-3874-4657-8656-c387af7c75c1 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-unplugged-99c47a93-30f6-45b2-89d8-14e173610ec8 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:51:01 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Instance destroyed successfully.
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.objects.instance [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lazy-loading 'resources' on Instance uuid 5b4f1195-f4db-414d-bd20-6f9393b98b7c {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-838236975',display_name='tempest-TestVolumeBootPattern-server-838236975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-838236975',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmYxS1OEDNwAz+3RdP8mFpeufwZ3BB7gSd2VBeBEiwDQrGpSi64yIUy9eTm4OrDYCGkgaDNfbQr1+lIooT0bqzWYPCiS9T83YxQdF+X1X1lCAkUYdfw4b56qDdYDMNOcg==',key_name='tempest-TestVolumeBootPattern-1365237666',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8a3f132369e4dd4a0eb84377e1d158e',ramdisk_id='',reservation_id='r-q1u061tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725340178',owner_user_name='tempest-TestVolumeBootPattern-1725340178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:46:14Z,user_data=None,user_id='e5366854e8ec4ed3a35c5b1b289ecab0',uuid=5b4f1195-f4db-414d-bd20-6f9393b98b7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converting VIF {"id": "99c47a93-30f6-45b2-89d8-14e173610ec8", "address": "fa:16:3e:c1:53:be", "network": {"id": "8dfe3099-0c7d-47aa-96f8-b232911db855", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-65572021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8a3f132369e4dd4a0eb84377e1d158e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c47a93-30", "ovs_interfaceid": "99c47a93-30f6-45b2-89d8-14e173610ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_vif [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99c47a93-30, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27777e1b-f74b-4f26-a1a4-9d45c800278b) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:02 user nova-compute[74701]: INFO os_vif [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:be,bridge_name='br-int',has_traffic_filtering=True,id=99c47a93-30f6-45b2-89d8-14e173610ec8,network=Network(8dfe3099-0c7d-47aa-96f8-b232911db855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c47a93-30')
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyeCZrbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:51:02 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[29664b3b-125c-4bfc-af18-2a1891f14c8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:51:02 user nova-compute[74701]: No targets found.
Oct 20 13:51:02 user nova-compute[74701]: iSNS:
Oct 20 13:51:02 user nova-compute[74701]: No targets found.
Oct 20 13:51:02 user nova-compute[74701]: STATIC:
Oct 20 13:51:02 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529
Oct 20 13:51:02 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:51:02 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:51:02 user nova-compute[74701]: FIRMWARE:
Oct 20 13:51:02 user nova-compute[74701]: No targets found.
Oct 20 13:51:02 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:51:02 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:51:02 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6deeb-e967-4706-959c-95327557d3ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5febc2b-c6b0-4d67-9f6d-824b048777f4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:51:02 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 (non-flash)
Oct 20 13:51:02 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc758280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529'): ({'sdc'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Removing single pathed devices sdc {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe06ca-05a6-49e8-91f4-b78e6252b93e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36eefe7-3e4c-4666-a3f0-cdffde2bc487]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Flushing IO for device /dev/sdc {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e3761-3244-4c10-9dad-b6b0b232841b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b87eb8-9c18-4e16-8a4e-3756de0aa985]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] SCSI volumes sdc have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23131356333396366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f1be37e1', '/dev/disk/by-id/scsi-1SCST_BIOf1be37e1-115c39cf90ffe909') {{(pid=85533) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[857eb8f1-01dd-4c80-944b-0bef68763b90]: (4, None) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e43e24-240d-47ca-9182-b7853f5c1e66]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[88890dea-ad66-439c-9d94-896280f0a861]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260]
Oct 20 13:51:02 user nova-compute[74701]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529, portal: 172.16.0.220,3260] successful.
Oct 20 13:51:02 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fef76f8-6f2f-4fc7-afce-49b38bbbd529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef6652-eab5-4efa-beef-e773edcc57bd]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] <== disconnect_volume: return (278ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:51:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Deleting instance files /opt/stack/data/nova/instances/5b4f1195-f4db-414d-bd20-6f9393b98b7c_del
Oct 20 13:51:02 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Deletion of /opt/stack/data/nova/instances/5b4f1195-f4db-414d-bd20-6f9393b98b7c_del complete
Oct 20 13:51:02 user nova-compute[74701]: INFO nova.compute.manager [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 20 13:51:02 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:51:02 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Took 0.45 seconds to deallocate network for instance.
Oct 20 13:51:02 user nova-compute[74701]: DEBUG nova.compute.manager [req-213f3d73-106d-4ebb-8a65-8f1c3fc4a55a req-9af9a225-d249-4865-b050-2249cfe84636 service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-deleted-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:51:03 user nova-compute[74701]: INFO nova.compute.manager [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Took 0.77 seconds to detach 1 volumes for instance.
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] Acquiring lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG nova.compute.manager [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] No waiting events found dispatching network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:51:03 user nova-compute[74701]: WARNING nova.compute.manager [req-8a114ca5-c4f4-45b8-84f4-05f0ce3795a4 req-68b7b5b2-f0bd-42ab-851b-1517a3158a8f service nova] [instance: 5b4f1195-f4db-414d-bd20-6f9393b98b7c] Received unexpected event network-vif-plugged-99c47a93-30f6-45b2-89d8-14e173610ec8 for instance with vm_state deleted and task_state None.
Oct 20 13:51:03 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:03 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Deleted allocations for instance 5b4f1195-f4db-414d-bd20-6f9393b98b7c
Oct 20 13:51:03 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-885e551f-eb48-4ffd-8c97-619f65e34f3d tempest-TestVolumeBootPattern-1725340178 tempest-TestVolumeBootPattern-1725340178-project-member] Lock "5b4f1195-f4db-414d-bd20-6f9393b98b7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:51:27 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:51:28 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.871707916259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c394f0f-9e62-45c7-9f31-bd274e497952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:51:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:51:32 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:51:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:51:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:51:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:51:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:51:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:41 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:41 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:51:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:51:52 user nova-compute[74701]: INFO nova.compute.manager [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Attaching volume 43e98a66-8259-428c-9254-0f232a8be9a2 to /dev/vdb
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c82dc1-b4d4-43f4-9a04-3cbccdad1382]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d39a6275038\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8210a14f-f6be-4fe6-a7d2-ec6600d8c6f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dccb996-4e87-4cca-834d-48578346e3a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab1dc4-a2b2-4b18-8767-62255843305a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Running cmd (subprocess): nvme version {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] nvme not present on system {{(pid=74701) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 13:51:52 user nova-compute[74701]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 13:51:52 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d0ce9-11c0-4c31-8c2d-9ddf3428f595]: (4, '') {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74701) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.lightos [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] LIGHTOS: no hostnqn found. {{(pid=74701) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG os_brick.utils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d39a6275038', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:51:52 user nova-compute[74701]: DEBUG nova.virt.block_device [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating existing volume attachment record: b6ddf427-fe45-4d06-bfbd-11c010c6f9b9 {{(pid=74701) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 13:51:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:13 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:52:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Calling os-brick to attach iSCSI Volume {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJtPuSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:52:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:52:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:52:25 user nova-compute[74701]: INFO os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c51ed-0f7e-4d8c-8f72-f73fd9f814be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 13:52:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b349c3-3e9f-44b4-b124-b8cfb8e0151b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2] added\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2] added
Oct 20 13:52:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825d8a7-2285-4a69-9fd6-43c26b6e44d1]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689634a-9c29-4c87-b39d-13f3277d4886]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJtPuSCs {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJtPuSCs" returned: 0 in 0.022s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9417bba9-c65c-4a4f-b1b3-ea422980355a]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJtPuSCs'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4ded1-d117-41ef-a9f6-6b2b1df3725d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc3004-04c7-416b-acbc-d63a8093c736]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:52:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 13:52:25 user nova-compute[74701]:  {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:52:25 user nova-compute[74701]: WARNING os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 13:52:25 user nova-compute[74701]: 
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --login {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fa2d2-28eb-41b4-9144-60fdd7ec3edd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260]
Oct 20 13:52:25 user nova-compute[74701]: Login to [iface: default, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260] successful.
Oct 20 13:52:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2625df-1cd5-43a5-8a0c-19231ac78d42]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea924c5-1393-4faa-9a10-916acad8cb74]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)
Oct 20 13:52:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)
Oct 20 13:52:25 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to 172.16.0.220:3260 {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74701) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74701) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e7cf3-9905-4869-b775-31b808604912]: (4, ('- - 0', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:52:25 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74701) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJtPuSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74701) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23035393038366365', 'path': '/dev/sdb'} {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035393038366365', 'path': '/dev/sdb'} {{(pid=74701) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 13:52:26 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 13:52:27 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:52:27 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:52:27 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:52:27 user nova-compute[74701]:   <serial>43e98a66-8259-428c-9254-0f232a8be9a2</serial>
Oct 20 13:52:27 user nova-compute[74701]: </disk>
Oct 20 13:52:27 user nova-compute[74701]:  {{(pid=74701) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74701) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] No VIF found with MAC fa:16:3e:5e:d2:4a, not building metadata {{(pid=74701) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 13:52:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0120185f-8d62-4144-8234-80a89bd2f3c8 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.780s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:52:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:52:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:52:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.86986541748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c394f0f-9e62-45c7-9f31-bd274e497952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:52:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG nova.compute.manager [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing instance network info cache due to event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated VIF entry in instance network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG nova.network.neutron [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:52:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b56e15bb-06e1-4360-a5c3-4131166f8a69 req-030f1ee7-5af2-4d78-813a-bee4f72af5ed service nova] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.compute.manager [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing instance network info cache due to event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated VIF entry in instance network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.network.neutron [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-b3c2ebce-a56e-4164-b86c-e5930e6e50ac req-5508e24e-e48d-4555-9735-c653c7fc1c64 service nova] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:32 user nova-compute[74701]: INFO nova.compute.manager [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Rebooting instance
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:52:32 user nova-compute[74701]: DEBUG nova.network.neutron [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Building network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:52:33 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] There are 0 instances to clean {{(pid=74701) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 13:52:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:35 user nova-compute[74701]: DEBUG nova.compute.manager [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:52:35 user nova-compute[74701]: WARNING nova.compute.manager [req-66d89247-ddf7-4cbc-8fec-a06374f8221c req-dde8c759-b3aa-46e7-8b3f-74a44b77238d service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state active and task_state reboot_started.
Oct 20 13:52:36 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance shutdown successfully.
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:37 user nova-compute[74701]: DEBUG nova.compute.manager [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:52:37 user nova-compute[74701]: WARNING nova.compute.manager [req-91ebd061-c35c-4a4c-85e3-ad825406e390 req-d21f8ab8-088e-43dc-9206-c295ee1402af service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state active and task_state reboot_started.
Oct 20 13:52:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:38 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:38 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance running successfully.
Oct 20 13:52:39 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance soft rebooted successfully.
Oct 20 13:52:39 user nova-compute[74701]: DEBUG nova.compute.manager [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Checking state {{(pid=74701) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-dcbac40b-37ad-4045-ae2e-8049e10a17ab tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.006s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:52:39 user nova-compute[74701]: WARNING nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state active and task_state None.
Oct 20 13:52:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:52:39 user nova-compute[74701]: DEBUG nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:52:39 user nova-compute[74701]: WARNING nova.compute.manager [req-4eedc0f4-a12d-48e9-bbdb-a1533e275e46 req-7dcaee48-deaa-4f70-95cd-33e8d4fa230f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state active and task_state None.
Oct 20 13:52:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:43 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:43 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:52:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74701) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 13:52:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:52:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:52:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:53:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:53:28 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74701) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 13:53:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:53:29 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=24.868236541748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c394f0f-9e62-45c7-9f31-bd274e497952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing inventories for resource provider 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating ProviderTree inventory for provider 40b83711-652c-474c-aa9f-09e010a7f984 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Updating inventory in ProviderTree for provider 40b83711-652c-474c-aa9f-09e010a7f984 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 13:53:29 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing aggregate associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, aggregates: None {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Refreshing trait associations for resource provider 40b83711-652c-474c-aa9f-09e010a7f984, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=74701) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Triggering sync for uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:53:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:53:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:33 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:34 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:53:34 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:53:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:43 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:44 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:53:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:53:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:53:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:53:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:54:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG nova.compute.manager [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing instance network info cache due to event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated VIF entry in instance network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG nova.network.neutron [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:54:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-a15f1f87-daf0-4da0-ad5a-248455fde2e2 req-e52c3539-fd11-4e0c-b1a9-72cba9df9921 service nova] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing instance network info cache due to event network-changed-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Refreshing network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:54:25 user nova-compute[74701]: INFO nova.compute.manager [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Detaching volume 43e98a66-8259-428c-9254-0f232a8be9a2
Oct 20 13:54:25 user nova-compute[74701]: INFO nova.virt.block_device [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Attempting to driver detach volume 43e98a66-8259-428c-9254-0f232a8be9a2 from mountpoint /dev/vdb
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Attempting to detach device vdb from instance 4c394f0f-9e62-45c7-9f31-bd274e497952 from the persistent domain config. {{(pid=74701) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:54:25 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:54:25 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:54:25 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:54:25 user nova-compute[74701]:   <serial>43e98a66-8259-428c-9254-0f232a8be9a2</serial>
Oct 20 13:54:25 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:54:25 user nova-compute[74701]: </disk>
Oct 20 13:54:25 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:54:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully detached device vdb from instance 4c394f0f-9e62-45c7-9f31-bd274e497952 from the persistent domain config.
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c394f0f-9e62-45c7-9f31-bd274e497952 from the live domain config. {{(pid=74701) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.guest [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 13:54:25 user nova-compute[74701]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 13:54:25 user nova-compute[74701]:   <source dev="/dev/sdb"/>
Oct 20 13:54:25 user nova-compute[74701]:   <target dev="vdb" bus="virtio"/>
Oct 20 13:54:25 user nova-compute[74701]:   <serial>43e98a66-8259-428c-9254-0f232a8be9a2</serial>
Oct 20 13:54:25 user nova-compute[74701]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 13:54:25 user nova-compute[74701]: </disk>
Oct 20 13:54:25 user nova-compute[74701]:  {{(pid=74701) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated VIF entry in instance network info cache for port dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6. {{(pid=74701) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG nova.network.neutron [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:54:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-d4312f64-1bdf-4a4c-84a0-282531d560d5 req-fb0f4505-61e2-4840-b165-480ff89edd46 service nova] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:54:26 user nova-compute[74701]: DEBUG nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 13:54:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:27 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:54:29 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:54:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=24.85968780517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Instance 4c394f0f-9e62-45c7-9f31-bd274e497952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74701) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:54:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:54:32 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:54:35 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquired lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Forcefully refreshing network info cache for instance {{(pid=74701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG nova.objects.instance [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lazy-loading 'info_cache' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG nova.network.neutron [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [{"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Releasing lock "refresh_cache-4c394f0f-9e62-45c7-9f31-bd274e497952" {{(pid=74701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updated the network info_cache for instance {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 13:54:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:37 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:54:42 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:54:42 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:45 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:45 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:54:46 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4c394f0f-9e62-45c7-9f31-bd274e497952 is timed out.
Oct 20 13:54:46 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully detached device vdb from instance 4c394f0f-9e62-45c7-9f31-bd274e497952 from the live domain config.
Oct 20 13:54:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] calling os-brick to detach iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e07f0730>, {'target_iqn': 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJtPuSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 13:54:46 user nova-compute[74701]: WARNING os_brick.initiator.connectors.base [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec143305-cf9a-437c-b185-0985a994856c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 13:54:46 user nova-compute[74701]: No targets found.
Oct 20 13:54:46 user nova-compute[74701]: iSNS:
Oct 20 13:54:46 user nova-compute[74701]: No targets found.
Oct 20 13:54:46 user nova-compute[74701]: STATIC:
Oct 20 13:54:46 user nova-compute[74701]: Target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2
Oct 20 13:54:46 user nova-compute[74701]:         Portal: 172.16.0.220:3260,-1
Oct 20 13:54:46 user nova-compute[74701]:                 Iface Name: default
Oct 20 13:54:46 user nova-compute[74701]: FIRMWARE:
Oct 20 13:54:46 user nova-compute[74701]: No targets found.
Oct 20 13:54:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 13:54:46 user nova-compute[74701]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 13:54:46 user nova-compute[74701]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74701) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2', 0)] {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[619090ab-7021-4113-bc09-261715a89fc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d575efe4-9dd7-4a4b-80d7-a0ac66da65d2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)
Oct 20 13:54:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 (non-flash)
Oct 20 13:54:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86bc75a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2'): ({'sdb'}, set())}) {{(pid=74701) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Removing single pathed devices sdb {{(pid=74701) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265f7dc-4721-4da2-9f47-9e4de297861b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd54997a-d6d8-475a-ab27-3def731476ac]: (4, ('ok\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Flushing IO for device /dev/sdb {{(pid=74701) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4ad12-1f31-4fe0-89da-eaf744990112]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74701) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b78276-dde6-4909-9d77-89cd5695d2c3]: (4, ('1', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.linuxscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] SCSI volumes sdb have been removed. {{(pid=74701) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2')] {{(pid=74701) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae61398-d201-4f95-b376-3bf65927a89b]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --logout {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31582d4-c18f-409e-8033-7a52252d3f6d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260]
Oct 20 13:54:46 user nova-compute[74701]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2, portal: 172.16.0.220,3260] successful.
Oct 20 13:54:46 user nova-compute[74701]:  stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op delete {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e98a66-8259-428c-9254-0f232a8be9a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85533) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323a53f-3d2b-4f63-a345-29458c13412d]: (4, ('', '')) {{(pid=85533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74701) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.base [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] <== disconnect_volume: return (308ms) None {{(pid=74701) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 13:54:46 user nova-compute[74701]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Disconnected iSCSI Volume {{(pid=74701) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 13:54:47 user nova-compute[74701]: DEBUG nova.objects.instance [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'flavor' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:54:47 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:54:47 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-97d8c657-2064-4b55-a7d5-b1bc423a90ec tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:54:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:54:52 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:54:57 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:02 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:07 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:12 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:22 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:24 user nova-compute[74701]: INFO nova.compute.manager [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Terminating instance
Oct 20 13:55:24 user nova-compute[74701]: DEBUG nova.compute.manager [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Start destroying the instance on the hypervisor. {{(pid=74701) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:24 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.compute.manager [req-7d975e7c-eece-422d-8f36-06da868d2136 req-698e05ff-abd9-4622-b349-b96c26dc68ac service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-unplugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with task_state deleting. {{(pid=74701) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Instance destroyed successfully.
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.objects.instance [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lazy-loading 'resources' on Instance uuid 4c394f0f-9e62-45c7-9f31-bd274e497952 {{(pid=74701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.virt.libvirt.vif [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T13:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-860528841',display_name='tempest-TestMinimumBasicScenario-server-860528841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-860528841',id=52,image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLLNCO9eLFf8i0SgJM2eWjSmUP4cid1rRr7HvIE7UNzourwyE/BbUlww6lk2Kzmrdhg/umOLHgk/zbRI8gG0xepc9SDS3MET4INIdjZ17zYrZfLEoBNel57FNbRLEBwoQ==',key_name='tempest-TestMinimumBasicScenario-1613711523',keypairs=<?>,launch_index=0,launched_at=2023-10-20T13:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f04195d30b684d72b548c2d11dca2b43',ramdisk_id='',reservation_id='r-weuaepf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d5dc7d11-d61e-405c-82fc-3b0c9d16ebfb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-76758976',owner_user_name='tempest-TestMinimumBasicScenario-76758976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T13:52:40Z,user_data=None,user_id='66b5f73e271a42eab0d3733e60317550',uuid=4c394f0f-9e62-45c7-9f31-bd274e497952,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converting VIF {"id": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "address": "fa:16:3e:5e:d2:4a", "network": {"id": "47578699-5630-41ca-b4a8-a1345aed2ab4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-54048461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f04195d30b684d72b548c2d11dca2b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b5d81-33", "ovs_interfaceid": "dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.network.os_vif_util [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33') {{(pid=74701) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG os_vif [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33') {{(pid=74701) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc3b5d81-33, bridge=br-int, if_exists=True) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=787c92ef-7e49-4f21-9edc-3aabd15bacac) {{(pid=74701) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:25 user nova-compute[74701]: INFO os_vif [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:4a,bridge_name='br-int',has_traffic_filtering=True,id=dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6,network=Network(47578699-5630-41ca-b4a8-a1345aed2ab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b5d81-33')
Oct 20 13:55:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Deleting instance files /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952_del
Oct 20 13:55:25 user nova-compute[74701]: INFO nova.virt.libvirt.driver [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Deletion of /opt/stack/data/nova/instances/4c394f0f-9e62-45c7-9f31-bd274e497952_del complete
Oct 20 13:55:25 user nova-compute[74701]: INFO nova.compute.manager [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 13:55:25 user nova-compute[74701]: DEBUG oslo.service.loopingcall [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74701) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.compute.manager [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Deallocating network for instance {{(pid=74701) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 13:55:25 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] deallocate_for_instance() {{(pid=74701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG nova.network.neutron [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Updating instance_info_cache with network_info: [] {{(pid=74701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 13:55:26 user nova-compute[74701]: INFO nova.compute.manager [-] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Took 0.60 seconds to deallocate network for instance.
Oct 20 13:55:26 user nova-compute[74701]: DEBUG nova.compute.manager [req-c7671e2e-0c9d-4f1b-b9d7-33475bef8837 req-260e45f5-54a4-465b-8f51-ced96670cf42 service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-deleted-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:55:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:26 user nova-compute[74701]: INFO nova.scheduler.client.report [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Deleted allocations for instance 4c394f0f-9e62-45c7-9f31-bd274e497952
Oct 20 13:55:26 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-7919bacc-6de9-4af0-9893-53bf26ba0fb9 tempest-TestMinimumBasicScenario-76758976 tempest-TestMinimumBasicScenario-76758976-project-member] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 13:55:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] Acquiring lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:27 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] Lock "4c394f0f-9e62-45c7-9f31-bd274e497952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:27 user nova-compute[74701]: DEBUG nova.compute.manager [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] No waiting events found dispatching network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 {{(pid=74701) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 13:55:27 user nova-compute[74701]: WARNING nova.compute.manager [req-89f1e214-b373-4e7b-94b2-9d1339217591 req-c85488fa-c6c7-46ec-91eb-60f686988e1f service nova] [instance: 4c394f0f-9e62-45c7-9f31-bd274e497952] Received unexpected event network-vif-plugged-dc3b5d81-3350-44c7-b4b0-fa5d81ee38f6 for instance with vm_state deleted and task_state None.
Oct 20 13:55:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:55:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:55:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=24.886966705322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:55:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:55:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:55:36 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:55:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:55:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:45 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:46 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:46 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74701) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 13:55:47 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:49 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:55:50 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:55:55 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:00 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:05 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:10 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:15 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:16 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:17 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:20 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74701) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74701) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 13:56:25 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:29 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:56:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:56:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:56:29 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:56:29 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Auditing locally available compute resources for user (node: user) {{(pid=74701) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 13:56:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:56:30 user nova-compute[74701]: WARNING nova.virt.libvirt.driver [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.923431396484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74701) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74701) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.compute.provider_tree [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed in ProviderTree for provider: 40b83711-652c-474c-aa9f-09e010a7f984 {{(pid=74701) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.scheduler.client.report [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Inventory has not changed for provider 40b83711-652c-474c-aa9f-09e010a7f984 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74701) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG nova.compute.resource_tracker [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Compute_service record updated for user:user {{(pid=74701) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG oslo_concurrency.lockutils [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 13:56:30 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 13:56:35 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:56:35 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:56:36 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:56:38 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 13:56:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Starting heal instance info cache {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 13:56:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Rebuilding the list of instances to heal {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 13:56:38 user nova-compute[74701]: DEBUG nova.compute.manager [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Didn't find any instances for network info cache update. {{(pid=74701) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 13:56:40 user nova-compute[74701]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74701) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 13:56:44 user nova-compute[74701]: DEBUG oslo_service.periodic_task [None req-0e4adbbc-8477-4cc3-962f-d25e82b7b404 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}